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ABSTRACT 

The Early Childhood Longitudinal Study (ECLS) tracks 
children throughout the country as they move from kindergarten through fifth 
grade. As part of the ECLS planning process, the possibility was considered 
of assessing the program environments of Head Start children before they 
entered the ECLS kindergartens. A review was conducted of selected 
large-scale studies of Head Start, Chapter 1, child care, and other preschool 
settings to ascertain the important dimensions of children's program 
experience and to recommend ways of measuring those dimensions. This paper 
reviews those dimensions and measures of early childhood program environments 
that could be used in studies of preschool program effects on children's 
development. Following an introduction, chapter 2 of the review defines the 
important dimensions of program environments, drawing largely from research 
on early care and education program quality and from Head Start practices as 
reflected in the Head Start Performance Standards and performance measures. 
The five dimensions discussed are (1) classroom dynamics; (2) classroom 
structure; (3) classroom staff characteristics; (4) administration and 
support services; (5) parent involvement. Existing measures are also 
described. Chapter 3 summarizes findings from the 11 studies in which these 
measures have been used and suggests implications for future research. 

Chapter 4 presents recommendations for measures to use in future research. 

Two appendices include a summary of selected studies of Head Start and other 
early childhood program environments and descriptions of observational 
instruments . (HTH) 
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Foreword 



Each year a large number of written documents are generated by NCES staff and 
individuals commissioned by NCES which provide preliminary analyses of survey results and 
address technical, methodological, and evaluation issues. Even though they are not formally 
published, these documents reflect a tremendous amount of unique expertise, knowledge, and 
experience. 

The Working Paper Series was created in order to preserve the information contained 
in these documents and to promote the sharing of valuable work experience and knowledge. 
However, these documents were prepared under different formats and did not undergo 
vigorous NCES publication review and editing prior to their inclusion in the series. 
Consequently, we encourage users of the series to consult the individual authors for citations. 

To receive information about submitting manuscripts or obtaining copies of the series, 
please contact Ruth R. Harris at (202) 219-1831 or U.S. Department of Education, Office of 
Educational Research and Improvement, National Center for Education Statistics, 555 New 
Jersey Ave., N.W., Room 400, Washington, D.C. 20208-5654. 
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Preface 



The Early Childhood Longitudinal Study (ECLS) is a study that will focus on 
children’s early school experiences beginning with kindergarten. The ECLS is being developed 
under the sponsorship of the U.S. Department of Education, National Center for Education 
Statistics (NCES), with additional financial and technical support provided by the Administration 
of Children, Youth and Families, U.S. Department of Education’s Office of Special Education 
Programs and Office of Indian Education, and the U.S. Department of Agriculture’s Food and 
Consumer Service. Approximately 23,000 children throughout the country will be selected to 
participate as they enter kindergarten and will be followed as they move from kindergarten 
through 5th grade. Base-year data will be collected in the fall of 1998, with additional spring 
follow-up data collections scheduled for 1999 through 2004. Information about children’s 
neighborhoods, families, schools, and classrooms will be collected from parents, teachers, and 
school administrators. 

Because of the magnitude and complexity of the ECLS, NCES has set aside an extended 
period of time for planning, designing, and testing the instruments and procedures that will be 
used in the main study. NCES and its contractor, the National Opinion Research Center, are 
using this time to examine a variety of issues pertaining to the sampling and assessment of young 
children and their environments. The design phase of the study will culminate in a large-scale 
field test during the 1996-97 school year. 

NCES has sought the participation and input of many individuals and organizations 
throughout the design phase of the ECLS. The participation of these individuals and 
organizations has resulted in a set of design papers that identify policy and research questions 
in early education, map the content of the ECLS study instruments to these questions, explore 
and evaluate different methods for assessing the development of children and for capturing data 
about their homes, schools, and classrooms. 

This paper is one of several that were prepared in support of ECLS design efforts. While 
the information and recommendations found in this paper have contributed to the design of the 
ECLS, specific methods and procedures may or may not actually be incorporated into the final 
ECLS design. It is our hope that the information found in this paper not only will provide 
background for the development of the ECLS, but will be useful to researchers developing 
studies of young children and their education experiences. 

Jerry West Jeffrey A. Owings 

ECLS Project Officer Program Director 

Data Development and Longitudinal 
Studies Group 
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BACKGROUND 



This paper is an outgrowth of planning for the Early Childhood Longitudinal Study (ECLS). 
ECLS is a study of the National Center for Education Statistics (NCES) being conducted by the 
National Opinion Research Center (NORC) and its subcontractors. Approximately 23,000 children 
throughout the country will be selected to participate as they enter kindergarten and will be followed 
as they move from kindergarten through fifth grade. Because of their importance in influencing 
children’s school outcomes, the environments in which children live and learn will be studied. NORC 
will collect extensive information about the children’s neighborhoods, families, schools, and 
classrooms from parents, teachers, school administrators, and the children themselves. The programs 
children experience before entering kindergarten are also an important influence in their growth and 
development through the elementary school years. 

As part of the early ECLS planning process, we considered the possibility of assessing the 
program environments of Head Start children before they entered the ECLS kindergartens. We 
reviewed selected large-scale studies of Head Start, Chapter 1, child care, and other preschool settings 
to ascertain the important dimensions of children’s program experience and to recommend ways of 
measuring those dimensions. NCES then commissioned this review to provide background 
information for researchers conducting longitudinal studies who may be interested in assessing 
children’s program experiences in a variety of prekindergarten settings. 
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I. INTRODUCTION 



Children do not grow up in isolation. Before they enter school, their growth and development are 
influenced by die nurturance of their family relationships (Laosa 1984; Powell 1989; and Scott-Jones 
1984), the economic resources of dieir neighborhoods (Brooks-Gunn, Duncan, Klebanov, and Sealand 
1993), and the quality of die out-of-home programs and care arran gements diey eiqierience (Hayes, 
Palmer, and Zaslow 1990). As children age and begin to spend more and more time outside of die family 
eaviranmoit, die predominant influence of the family be gins to wane, and die influence of neighborhood 
and program environments gains in irrqxirtance (Cochran and Riley 1990). By die time children reach age 
4, qjproximately 50 percent attend formal center-based programs for at least a portion of die day (West, 
Hausken, and Collins 1993). Of this group, almost 750,000 attoid Head Start for one or more years before 
entering kindergarten. 

As preschool, child care. Head Start, and other early education programs become increasingly 
important in the lives of children and dieir families, policymakers and researchers look for ways to assess 
the dimensions of program experiences and relate diem to children’s growth and development. The 
puipose of this papCT is to review dimaisions and measures of early childhood program environments that 
could be used in studies of preschool program effects on children’s development. In Ch^ter n, we define 
the important dimensions of program environments, drawing largely from research on early care and 
education program quality and from Head Start practices as reflected in die Head Start Performance 
Standards (U.S. Dqiartmoit of Health and Human Services 1984) and performance measures (Ellswordi 
Associates 1995). In addition. Chapter II describes existing measures. In Ch^ter ID, we summarize 
findings firan die 1 1 studies in which diese measures have been used and su gg est implications for future 
research Our review focuses on large-scale studies of Head Start and related early childhood programs 
that have used classroom observation instruments and/or surveys to assess dimensions of program quality 
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and were conducted within tiie past sev^ years (see Appendix A). Ouqjter IV presents our 
recommendations for measures to use in future research. 

Chapters II and III largely draw iqjon the same literature. In Chapter n, our focus is on 
conceptualizing the m^or dimensions of earty childhood program envir onm ents and describing instr uments 
used for assessing those dimensions. In Ch^ter m, we s ummari ze finding s r elating program 
d imens ions to children’s development and well-being and use diese finding s to suggest strategies for 
conducting future research, in terms of bodi cmiceptual focus and methodological approaches. 
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II. DIMENSIONS AND MEASURES OF PROGRAM ENVIRONMENTS 



Hundreds of variables have been identified in past efforts to measure early childhood program 
environments. To provide a conceptual organization of the variables, we discuss five dimensions 
common^ used to describe features of the program environment for children enrolled in early childhood 
programs; (1) classroom dynamics, (2) classroom structure, (3) classroom staff characteristics, (4) 
administration and siqiport services, and (S) parent involvement. In fiiis chtq)ter, we describe these 
dimensions and the major instruments used for measuring their characteristics. 

In seeking precedents for omceptualizing die dimensions of program environments, we examined the 
literature on program quality. Quality typically is conceptualized as the features of children’s environments 
and eiqieriences that are presumed to be beneficial to dieir well-being. Extensive research has investigated 
die extent to i^ch features of program environments are empirically associated with aspects of children’s 
growth and development (see, for example, reviews by Hayes et al. 1990; Howes 1988, and 1990; and 
Phillips 1987). On die basis of a blend of research and practice, the National Association for the Education 
of Young Children (NAEYC) has developed detailed descriptions of the elements , of quality in i^diat it 
refers to as “developmentally tqipropriate practice” (Bredekamp 1987). In developmentally tqipropriate 
programs, caregivers encourage children to be actively engaged in a variety of activities; have fi’equent, 
positive interactions with children that include smiling, touching, holding, and speaking at children’s eye 
level; promptly respond to children’s questions or requests; and encourage children to talk about their 
eiqieriences, feelings, and ideas. Caregivers also listen attentively; ask open-ended questions and extend 
children’s actions and verbalizations with more complex ideas or materials; interact with children 
individually and in small grotq)s, instead of exclusively with the class as a whole; use positive guidance 
techniques; and encourage tq)propriate independence. 
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In addition to teacher or caregiver behaviors, vsiiich form die core of die dynamics of children’s 
classroom eiq>eriences, definitions of quahty often include structural features of die program (such as 
classroom structure and safety features), program administration, and supportive services (Ferrar 1996). 
No clear agreement exists, however, on how to categorize die large number of raivironmental variables 
used to define dimensions of quality and vdiat factors to include in each dimension. In part, disagreemait 
stems from different perceptions about i^diedier a variable is essential to a quality environmait diat 
promotes optimal child development or is correlated widi quality but is not an essential ingredient 

Howes (1992) views quality of program as one of diree broad sets of variables required for 
understanding characteristics of child care, including preschool programs. (The odier two are child care 
history, and die nature and form of die child care setting~for example, informal or formal, for-profit or 
nonprofit.) For Howes, quality variables fall into diree categories: structure, process, and practice (or 
curriculum). Harms (1992) defines two m^or categories of early childhood program variables: (1) 
administration, and (2) children’s program functions. Administration includes personnel, program 
resources, and management Childrrai’s program functions include structural variables (space, materials, 
people, and recurring patterns) and processes or interactions. 

Ltyzer, Goodson, and Moss (1993) define quality in terms of diree sets of classroom processes: 
(1) pattern and content of activities and groups across die day; (2) behavior and interactions of teaching 
staff; and (3) behavior and interactions of children. These authors consider odier program elements as 
potential predictors of quahty. Thus, whereas many researchers consider such factors as child-staff ratio 
or teacher experience to be aspects of quahty, Layzer et al. classify diese factors (vdiich are primarily 
characteristics of die classroom, die program, and the staft) as program elements to be understood because 
diey may strongly influence die quahty reflected in classroom processes. Love, Ryer, and Faddis (1992) 
also view quahty elements as classroom-based but include structural variables (such as groiq) size and 
child-staff ratio), along widi classroom dynamics, children’s behavior, and die behavior of caregivers. 
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They view other program variables (such as staff qualifications, child turnover, program auspice, and 
parent involvement) as contextual factors that may influence classroom quality. 

Phillips (1987), on the other hand, argues that quality is a configxiration of ingredients that include 
child-staff ratios, staff training, and parent participation. Phillips and Howes (1987) note that quality 
dimensions include (1) structural aspects, such as groiq} conq)Osition and staff qualifications; (2) dynamic 
aspects of diildren’s daily e?q)etience; and (3) contextual aspects, such as type of setting and staff stability. 
Similariy, in developing definitions and measures of quality for die E?q)anded Child Care Options (ECCO) 
study, Ferrar (1996) takes a broad view of quality as raicompassing four domains; (1) die classroom 
(including child and adult interactions, physical environment and materials, developmentally ^propriate 
practices, and structural features), (2) the program’s supportive services (including health, mental health, 
nutrition, social services, and parent involvement), (3) program administration (staff qualifications, groiqi 
size and ratio, planning and evaluation, personnel practices, and continuity of care), and (4) safety 
(facilities, outdoor play space, and safety procedures). 

The two common features of diese conceptualizations of program enviromnents are (1 ) the distinction 
between die c^namic (interactional) and structural features of classrooms and (2) die acknowledgment that 
the larger program context or characteristics found outside the classroom are important determinants of 
die quality of children’s classroom experience. Therefore, we include classroom dynamics and structure 
as die first two program environment dimensions. Consistent with the research hterature, we di.stinguish 
three additional dimensions of the program environment; (1) classroom staff characteristics, 
(2) administration and si^port services, and (3) parent involvement. Table II. 1 summarizes die classroom 
and program variables that we discuss under each of the five dimensions. 



A. CLASSROOM DYNAMICS 

The (lynamics of die classroom oivironment describe die processes through which children learn and 
interact on a daily basis. These processes include the interacdons children have with adults and with each 
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SUMMARY OF VARIABLES MEASURING EARLY CHILDHOOD CLASSROOM AND PROGRAM ENVIRONMENTS 
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other, as well as die interactions among adults. After discussing the attributes of classroom dynamics, we 
review commonly used instruments for measuring them 

1. Attributes of Classroom Dynamics 

By definition, classroom dynamics comprise all the interactions of children and adults. Because of 
the importance of teaching strategies and curriculum focus for children's development (Burts, Hart, 
Charlesworth, and Kirk 1990; and Marcon 1994), we believe it is useful to separate out those teacher-child 
interactions that are used to characterize “teaching.” We refer to these as program activities. We also 
include classroom materials as a component of dynamics, because how children interact with materials and 
how teachers use them in their instruction are more important for children’s development than are the 
physical attributes of the materials. 

Therefore, we characterize classroom dynamics by focusing on three attributes of the classroom 
environment; (1) interactions, (2) curriculiun and activities, and (3) materials that caregivers and children 
use. Classroom interactions include the maimer in which teachers and caregivers interact with chil dren 
and how children interact with each other. Specifically, interactions encompass the re lationshi p between 
children and teachers, the level of direction teadiers provide and iiutiative children take, teacher acceptance 
of children, the level of teacher feedback, the relationships among children, and the level of child 
participation and responsibility in classroom activities. Interactions also include the informal assessments 
teachers use to monitor their classrooms’ (fynamics and to make adjustments to accommodate children’s 
needs. 

Some writers distingitish classroom practices, or curriculum, from other features of dynamics (see, 
for example, Howes 1992); however, we include curriculiun practices in this dimension because they 
encompass many of the dynamics of caregiver-child interactions. Thus, another important attribute of 
classroom c^mamics is the classroom activities that constitute developmentally qipropiiate or in^propriate 
practices. Important aspects of classroom activities include the balance between instructional and play- 



oriented activities, the balance between groiq) and individiial activities, the level of fine and gross motor 
activities in which children engage, the nature of activities supporting social and cognitive development, 
and the degree to which the activities are well planned and organized. The materials with which children 
interact in their learning environment can be described in terms of their ^propriateness for the 
developmental level of diildren in the classroom. 

2. Instruments for Measuring Classroom Dynamics 

The available instruments we describe measure different aspects of classroom dynamics; provide 
different techniques for describing, coding, and classifying this inqrortant feature of the program 
environmoit; and have varying levels of precision in measuring classroom dynamics. The ease of training 
field staff to use die instruments also varies considerably. Classroom dynamics is the one dimension of 
the five we discuss that requires direct observation. (Although some studies have attempted to use survey 
methods, diese are unsatisfactory for crqituring the dynamics of classroom interactions most likely to 
enhance children’s development.) 

In studies examining the quality of early care and education programs, five instruments have been 
used most widely for measuring dimensions of classroom dynamics; 

1 . Early Childhood Environment Rating Scale (ECERS) 

2. Assessment Profile for Early Childhood Programs (Assessment Profile) 

3. Amett Scale of Caregiver Behavior (Arnett Scale) 

4. Classroom Practices Inventory (CPI) 

5. Preschool Classroom Snapshot (PCS) 

Table n.2 summarizes these instruments and die dimensions they measure; i^ipendix B provides more 
details and psychometric information. The first four instruments yield global, or overall, measures of the 
quality of classroom dynamics and provide ratings of a number of classroom dynamics. The fifdi 



OBSERVATION INSTRUMENTS MEASURING EARLY CHILDHOOD CLASSROOM DYNAMICS 




cn4 



UJ 

CQ 

■< 

5 

O 

O 

LU 

CQ 



u 

00 

c 

9 



o 

«s 

u 

9 

s 

o 



^5S=3 

cvj 






o 

ERIC 



instrument, the Preschool Classroom Sn^shot, is a “micro-observation” measure that gives more-detailed 
characteri^tions of specific elements of classroom dynamics.' 

The ECERS, Assessment Profile, and PCS are observational tools diat describe both the dynamics 
and the structure of the classroom. For classroom dynamics, they include both interactions and program 
activities. ECERS rates the value of a diild’s classroom experiences in several areas; language-reasoning 
eiqieriences, fine and gross motor activities, creative activities, and social development The Assessment 
Profile fbcuses on four aspects of the dynamic classroom environment; (1 ) the learning environment (play 
materials, arrangement of classroom space), (2) die curriculum (si^porting a variety of learning 
experiences, encouraging active involvement of children), (3) interactions (teacher-child interactions, 
teacher responsiveness to children), and (4) individualizing (siqiporting children’s unique needs). The PCS 
records the types and frequency of specific classroom activities and the ways in v^ch children are 
grouped. Activities from the PCS can be coded in various ways, including administrative, 
concrete/manipulative, symboUc, and active plt^. For exanqjle, playing widi blocks can be classified as 
symbolic play or simply coded as block plt^. An advantage of these detailed observation records is that 
researchers can later interpret the data in a variety of ways. 

I 

The Amett Scale and the CPI fiicus only on classroom dynamics. The Arnett Scale allows researchers 
to classify teacher bdiavior and interachons along five or sk dimatsions. Depending on the study in vhich 
the measure has beat used, caregiver behavior is categorized in terms of (1 ) positive relationships (warm, 
responsive, attentive, and encouraging), (2) ptmitiveness (harsh or critical), (3) detachment. 



'Micro-observahon measures characterize fine-grained behaviors and interactions wifoin a classroom. 
For example, every 10 minutes an observer could count foe number of different grotq>s of children in a 
classroom and foe number of diildren in each groiq}. Using this information, researchers can calculate foe 
average number of grotq^s over foe course of a d^. In contrast, for a global assessment of foe same 
variable, an observer might rate foe classroom as having few, some, or many different groiq}ings of 
children. 
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(4) permissiveness (or controlling behaviors), and (5) prosocial interactioa^ Hie CPI focuses on program 
activities. It describes developmentally appropriate practices using questions on direct experiences, 
concrete materials, child-initiated activities, and social interactioa 

In addition to diese observation instruments, some surveys have obtained teacher or administrator self- 
reports about classroom practices. For exanqile, die National Transition Study (NTS) surveyed school 
administrators to obtain ratings on die extent to i^ch developmentally r^propriate and iiuqipropriate 
practices occurred in kindergarten classrooms (Love, Logue, Trudeau, and Thayer 1 992). The same items, 
derived from NAEYC guidelines, could ^ply to Head Start classrooms. Surveys are not ideally suited 
for measuring classroom dynamics, however; we recommend using such measures only if observations 
are not feasible. 

The observational instruments listed differ in dieir ease of use. As one of die earhest attempts to 
quantify die quality dimensions of early diildhood programs, the ECERS has been widely and rehably used 
(in 4 of the 11 studies reviewed here). Its ratings are complex because each of die 37 items is 
multidimensional. Nevertheless, clear statements describe rating levels for each item, and raters can be 
trained to make reliable ratings (Scarr, Eisenberg, and Deater-Deckard 1994). The Assessment Profile 
is more strai^tforward because simple descriptive statements are rated “yes” or “no.” (For example: “A 
quiet activity area exists in die room where one or two children may choose to be alone.”) As a 
consequence, training is somei^^at easier for the Assessment Profile dian for die ECERS. However, die 
ECERS measures richer gradations in classroom quality. The CPL like die Assessment Profile, uses 
simpler statements than die ECERS. Because it is newer, it is closely ahgned widi die characteristics of 
developmentally ^propriate and in^propriate practices as articulated by NAEYC (Bredekamp 1987). 
The Arnett Scale t^s dimensions that are not measured by die ECERS, die Assessment Profile, or die CPI. 

^ost studies have reported die results of factor analysis of the 26 Arnett items. Aldiough die factor 
structures are highly conqiarable across studies, researchers have used somewhat different labels for die 
factors. 
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It requires more judginent on die part of die observer; widi training and practice, however, observers can 
use die scale reliably (Layzer et al. 1993; and Love, Ryer, and Faddis 1992). 

While these instruments have been widely used in studies of early care and education programs, some 
have also been used to measure kindergarten classrooms. The study of Ch^ter 1 (now Tide I) early 
childhood programs (Seppanen, Godin, Metzger, Bronson, and Cichon 1993) examined (1) die 
relationships between Chtqiter 1 prekindergarten classroom environments and children’s cognitive and 
socioemotional development, and (2) die w^ in i^ch children’s progr ammati c experiences changed 
fiom prekindergarten to kindergarten. The study used all five of diese instruments, or adt^tions of diem, 
to examine bodi classroom cfynamics and classroom structure in SS prekindergarten classrooms and 48 
kindergartQi classrooms. No studies, to die best of our knowledge, have used diese instruments in any of 
the higher grades, aldiough one version of the Assessment Profile is designed for assessing die quahty of 
school-age child care for children 5 to 10 years of age. 

B. CLASSROOM STRUCTURE 

The structure of die classroom environment refers to die noninteractive aspects of die child’s 
surroundings. These are considered important features of die classroom because many aspects of die 
physical classroom can eidier enhance or detract fiom the early childhood learning environment. Structural 
components often assume prominence in discussions of program quality because diey are readily observed, 
can be more easily regulated than classroom dynamics, and have been shown to relate to bodi dynamic 
features of die classroom and to children’s well-being (Hayes et al. 1990; Howes, P hilli ps, and Whitebook 
1992; Ruopp, Travers, Qantz, and Coelen 1979; and Whitebook, Howes, and PhiUips 1989). 

1. Attributes of Qassroom Structure 

We characterize die structure of the classroom by focusing on tibree elements; (1) physical space 
(including variables describing safety and healdi features and adult needs), (2) stability or turnover in 



enrollment, and (3) organization of caregivers and children in the classroom. The physical space of the 
classroom environment includes the quantity and the quality of the space, both for children and adults. 
Variables that measure space enconqiass the following features of a classroom facihty; square footage; 
provision of private, comfortable areas for children; child-sized facilities; space for groi^i activities; safety 
features (bodi inside and outside); separate space exclusively for adults; space that is accessible to children 
with special needs; and a professional hbrary for staff. 

The stability of a classroom is reflected in rates of child and teacher turnover. The components of 
child turnover include the number of vacancies in the center over the year, foe length of time needed to fill 
vacancies, and foe absentee rate. Perh^s foe best index, however, is simply foe number of children ever 
enrolled during a year relative to foe average daily attendance. (We include teacher turnover as a staff 
characteristics variable.) 

Finally, foe manner in >\iiich a classroom is organized includes foe size of foe classroom, foe child- 
staff ratio, foe groiqiings of children, foe numbers of children of different ages, foe numbers of staff by role, 
and foe number of volunteers or aides. Pardy because they are inexpensive to measure and amenable to 
regulation and monitoring by licensing agencies, child-staff ratio and group size have become two 
commonly used indicators of classroom quality. NAEYC provides standard guidelines for both of these 
components of a classroom’s structure. These structural variables have been foimd to be related to foe 
level of individual care and attention a child receives, as well as to foe quality of a child’s interactions with 
other children and with adults. Because of these relationships, these structural features often are described 
as proxies for quality. 



2. Instruments for Measuring Classroom Structure 

Three observation instruments already discussed (foe ECERS, Assessment Profile, and PCS) have 
beat used frequently to measure foe structure and organization of early care and education programs. In 
addition, data on many of foe classroom structure variables have been coUected through interviews with 
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program administrators and caregivers. Table n.3 summarizes die major observation instruments and 
studies that have used diem. 

All three of die observation instruments are versatile, collecting information on classroom structure 
and odier aspects of the overall program environment. The ECERS depicts classroom structure through 
three broad topic areas: (1) classroom furnishings; (2) personal-care routines of children; and (3) adult 
needs, including die availability of areas for personal use and meetings. The Assessment Profile depicts 
classroom structure piimaiily through die safety and healdi features of a classroom (that is, safe supplies, 
preparation for accidents and emergencies, the availability of first-aid supplies, existence of emergency 
procedures, and maintenance of personal hygiene). The PCS, using a time-sampling technique, looks at 
classroom , structure by examining groupings of children, child-staff ratios, and total group size during 
different periods in die day. 

Observation instruments are best suited for collecting data on child-staff ratio, groiqi size, physical 
space, safety, and healdi characteristics. However, the Profile of Child Care Settings (PCCS) stucfy 
(Kisker, Hofferdi, Phillips, and Farquhar 1991) demonstrated die feasibility of using survey measures to 
gather data on child-staff ratio, group size, and healdi and safety features. Nevertheless, comparisons of 
self-report and observation data indicate that die two mediods do not yield identical results on groiqi size 
and child-staff ratio (Love, Ryer, and Faddis 1992; and Scarr et al. 1994). In spite of diese shortcomings, 
survey interview mediods have been used to obtain measures of structural variables diat are as.tr dated 
widi dynamic variables and are much less expensive (Layzer et al. 1993). Director interviews or program 
records are best suited for obtaining information on student stability or turnover in enrollment. For 
example, die National Child Care StafSng (NCCS) study used interviews widi program directors and staff 
to gather data on classroom stability, child turnover, and die organization of teachers and caregivers 
(Whitebook et al. 1 989). The PCCS study asked a series of survey questions on child turnover (Kisker 
etal. 1991). 
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OBSERVATION INSTRUMENTS MEASURING EARLY CHILDHOOD CLASSROOM STRUCTURE 
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C. CLASSROOM STAFF CHARACTERISTICS 

Many studies have examined die link betweoi staff characteristics and classroom dynamics. Teachers 
or caregivers widi higher levels of training and education in child development often facilitate a high level 
of developmentally ^propriate activities and interaction in dieir classrooms (Love, Ryer, and Faddis 
1 992). In turn, children attending classrooms widi more-highly trained caregivers may exhibit a higher 
level of positive bdiavior and development (Hayes et al. 1 990; Howes, Smith, and Galinsky 1 995; Philhps 
and Howes 1 987; and Ruopp et al. 1 979). For diese reasons, it is in^iortant to measure these aspects of 
staff characteristics. The studies discussed here used surv^r data to measure staff characteristics and 
related diese measures to odier dimensions of program quaUty in Head Start and odier center-based 
settings. 

1. Attributes of Staff Characteristics 

The staff characteristics measured in the studies we reviewed span seven attributes; (1) educational 
attainment, (2) development and training opportunities, (3) eiqierience, (4) salaries and benefits, (5) rate 
of turnover, (6) professionalism, and (7) demogrtqihics. Staff, as discussed here, includes paid and unpaid 
teachers, caregivers, and aides. (Characteristics of administrators are described later under administration 
and si^jport services.) Numerous studies have shown that in^ortant link.s exist between staff quaUty and 
other dimensions of program quality, particularly classroom dynamics. 

Educational attainment of classroom staff is reflected in bachelor’s degrees or advanced degrees in 
early childhood education. Child Development Associate (CDA) credentials, and otiier child development 
certificates, hcenses, and credentials. 

Distinct fixim education is tiie level and content of further development and tr aining that staff members 
receive during tiie course of their careers in the field of early childhood care and development. Providing 
teachers witii opportunities for training and continuing education is another important conqxment of 
program quahty. These training opportunities can include a variety of topics, incl uding tiiose relating to 
O 16 
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early childhood care and education, child development, family development, and commumty building. 
Training ^proaches can involve course work and training in child care and development, in-service 
training and siq)port, and outside workshops and classes. 

In addition to education and tr ainin g, it is equally important to identify die nature and level of staff 
ejqjerience. E^qierience ^ically includes die number of years of teadiing eiqierience, number of years 
of early childhood program ejqjerience, number of years in the current program, and odier types of 
positions held. 

Salaries and benefits, wdiich may correlate with the level of eiqjerience, represent a distinct element 
of program quality. Paying rqjprppriate salaries and providing adequate benefits may help programs attract 
well-educated and trained staff members and minimize the degree of staff turnover. The key components 
of die salaries and benefits dimension include opportunities for advancement; die wage structure of die 
center, and the range of benefits, including insurance, paid sick and personal days, and retirement benefits. 
Maintaining low staff-turnover rates, defined by die length of employment of staff members, allows a 
program to offer more continuity in die curriculum and a more stable environment for children. 

Professionalism is defined in a number of ways, including the manner in wdiich staff members are 
assigned and promoted, provisions for staff input into hiring decisions, staff s philosophy and ^proach to 
teaching, leadership abihty, and professicmal satisfaction. Hiese variables, many of wdiich can be measured 
dirough survey questions, provide valuable contextual information relating to staff characteristics. Finally, 
staff demogrsqjhics encompass background information such as die gender and racial makeup of staff, die 
racial and ethnic match between staff and children served, and die extent to wdiich staff members represent 
die larger community in i^diich children live. 

2. Instruments for Measuring Staff Characteristics 

No standardized instruments have been widely used for gadiering information on caregiver, teacher, 
and staff characteristics. Each of die studies we reviewed developed its own survey instruments to 



interview caregivers and administrators, aldiough there is considerable overls^ in questions asked. These 
instruments provide information on one or more of die seven aspects of staff characteristics; diis 
information has allowed researchers to examine the relationship between diese characteristics and other 
dimensions of program quality. Table IL4 summarizes the types of staff characteristics diat are measured 
in die studies leviewed in diis report. 

For die Observadonal Stucty of Early Childhood Programs (OSECP), Layzer et al. (1993) conducted 
staff interviews to gadier informadon on staff background and experience, development and training, 
teaching approach and philosoplty, leadership style, and demographics. The NTS included survey 
questions about types of staff development and training opportunities provided by die school and diose in 
which at least half die kindergarten teachers participated. 

The NCCS study examined child care centers in terms of dieir value as work environments for 
teachers and staff members, to determine how that environment affects die quahty of care (Whitebook et 
al. 1989). The maimer in i^ch characteristics of teachers and staff members are linked to die quality of 
care was also examined. NCCS developed staff interviews and director interviews to gadier data on staff 
demographic background, child care experience, other positions held, wages and benefits, educational 
attainment, professional satisfaction, staff turnover and stability, and personal recommendations for 
improving die child care profession. Howes (1992) reports diat one-week test-retest reliabihty for die 
NCCS study interview ranged from .79 to .84 across items, widi an average rehability coefficient of .82. 
Selected questions from this interview were also used in the PCCS survey (Kisk» et al. 1991). Few 
studies report reliability evidence for interview items. 

The PCCS’s center-based program survey instrument collected data on bodi individual staff members 
and die overall program Information was obtained on the educational attainment of individual classroom 
staff members, years of experience in a preschool setting, types of child-related training, extent of child- 
related training widiin die past year, and salaries and benefits. The survey also obtained data on program 
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TABLE H.4 (continued) 



CXDP “ 
CQCO = 
CSCR = 
ES 
FSC 

HSFCC = 
JOBS “ 
NCOS “ 
NTS 

OSECP - 
PCCS = 



Comprehensive Child Development Program evaluation. 

Cost, Quality, and Child Outcomes in Child Care Centers. 
California StafFChild Ratio study. 

Even Start family literacy national program evaluation. 

Head Start Family Service Center demonstration. 

Head Start Family and Classroom Correlates study. 

Job Opportunities and Basic Skills training program evaluation. 
National Child Care Staffing study. 

National Transition Study. 

Observational Study of Early Childhood Programs. 

Profile of Child Care Settings study. 
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characteristics, such as the use of specialists, staff turnover, and the lengdi of time needed to fill teaching 
vacancies. For these items, we therefore have means and frequency distributions for a nationally 
representative sample of programs that includes Head Start craters. 

D. ADMINISTRATION AND SUPPORT SERVICES 

The administrative skill with which early care and education progr am.*; are managed and the 
supportive services provide for children and families influrace their effectiveness in meeting the needs 
of children and families. Effectively run programs maintain fiscal responsibility viiile limiting unnecessary 
costs, maintaining the quality of care and services, and tailoring services to meet the unique needs of 
diildrra and famihes. Through the creative tise of supportive services, program directors can also provide 
more conqirehensive siqiport to children and their families. To tailor services to unique needs and family 
environments, programs collect and track detailed socioeconomic and demographic data on the children 
and families to whom they provide services. Although evidrace of relationships between administrative 
variables and child outcomes is scant, all of the studies examined here have built these elements into their 
data collection to vaiying degrees. The Cost, Quahty, and Child Outcomes in Child Care Centers (CQCO) 
study will yield analyses of these relationships for its large multistate sample of progr am*; The survey 
instruments and information systems discussed next measure a variety of aspects of program 
administration and support services. 



1. Attributes of Administration and Support Services 

We examine six attributes of administration and support services: (1) qualifications of the program 
director or administrator, (2) coordination with and assessment of staff, (3) program administrative 
characteristics, (4) program schedule, (5) financial capacity, and (6) supportive services for children and 
families. The qualifications of the director/administrator include characteristics such as educational 
attainment and professional degrees held, prior experirace in early child care and education, prior 
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sqjerience in nonprofit organization management, and relevant training courses. Coordination widi and 
assessment of staff indudes die nature of die relationship between program management and teachers and 
caregivers. Directors and managers ^^ilo empower staff members, foster open channels of commumcation, 
and cultivate relationships widi odier organizations in die co mmuni ty may develop more positive and 
effective working r elatio nships widi dieir staff. Specifically, diis area includes variables diat measure 
administrative leadership and philosopl^; staff members’ satisfaction widi die working environment and 
dieir role in it; staff iiqiut into program decisions; management*staff interactions through regular meetings 
and interacdons; structured mediods for staff evaluation and assessment; and clearly defined persoimel 
policies and procedures. The literature does not generally provide en^iirical links between administrative/ 
support services and child outcomes. It does, however, offer insights into die relationship between 
administrative/support services and quahty. We discuss diese variables in terms of die program 
environment assessment because we believe diey represent important dimensions of overall program 
quahty for Head Start and odier early childhood programs. 

Providers with a number of different financial structures, sponsors, and standards exist in today’s early 
care and education market Four important administrative characterisdcs to consider in distinguishing one 
program type from anodier are (1) auspice (pubhc, nonprofit, for-profit), (2) hcensing by state agencies, 
(3) sponsorship (diurch, school), and (4) accreditation dirough NAEYC. The state in vdiich die provider 
is located is also an inqiortant factor, because a range of standards for early care and education providers 
exists among states. In addition, an understanding of die providers’ goals, philosophy, and mission can 
provide important cmitextual information. Aldiough program auspice and hcensing are not relevant for 
Head Start, sponsorship and accreditation may be. 

The schedule of a child care facihty can also affect children’s eiqieriences and die hves of parents. 
Early childhood programs vary in dieir daily hours of service, d^ per week, and in the number of weeks 
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per year that the program is available. Higher-quality programs offer a schedule of care that better suits 
the needs of the children’s parents and families. 

Both the financial edacity of an organization and the effectiveness of its resource management 
influence overall program and classroom quality. Important conqionents of financial edacity include (1 ) 
total revenues and total net revenues, (2) subsidies and donations received as a percentage of total 
revenues, (3) per-child cost of care, and (4) parental fees charged as a proportion of total revenues. 
Volunteer assistance (both in the program office and in the classroom) also may be an important indicator 
of the level and effectiveness of administrative siqrport services. A higher level of volunteer assistance may 
decrease the per-child cost of care. 

The financial edacity of a program may also affect the extent to which it can provide a range of 
supportive services to children and families. Supportive services may include availability of health care 
services (such as immunizations, well-child checkups, and nutrition counseling), dental services, and 
mental health services at the center; maintenance of health records; case management and monitoring; 
referrals of children, parents, and families to other community agencies for social service needs (such as 
health, nutrition, job training, public assistance, literacy training, child abuse and neglect, and substance 
abuse); and the level of collaboration and information sharing widi other community service providers. 



2. Instruments for Measuring Administration and Support Services 

Data on administration and support services typically have been gathered through interviews (both 
by telephone and in person) and self-administered questionnaires. These interviews and questionnaires 
have collected data that can be used to examine the relationships between administration and si^port 
services and other dimensions of quality. By selecting ^propriate items from diese instruments, 
researchers can obtain information in ways that promote conqiarabilily with other studies. Table n.4 
summarizes the six key types of administration and support service variables measured in the studies 
examined here. 
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For tiie OSECP study, Layzer et al. (1 993) collected data on program philosophy and die leadership 
style of die director through staff and director interviews. In a study for die state of California, Love, 
Ryer, and Faddis (1992) cultured data on program goals and philosophy through interviews widi program 
directors. A classroom data form provided siqiplementary information on die number of children i^ose 
families paid full or subsidized fees. 

The NCCS study, through its analysis of the work environment of child care centers, collected 
information from directors on dieir background and qualifications, as well as on program goals, history, 
auspice, budget, and level of program subsidization (Whitebook et al. 1989). The PCCS collected 
information on program administration and siqipcnt services using conqiuter-assisted telephone interviews 
widi child care center directors (Kisker et al. 1991). Information relevant to diis area includes program 
goals, fees charged to parents, subsidies received, auspice, sponsorship, accreditation and hcensing, and 
siq)port services (such as healdi services and meals). 

The Head Start Family Service Center (FSC) demonstration collected information on die 
administration and siqiport service characteristics of Head Start programs through a self-administered 
project director questionnaire. Important items focused on program characteristics, staff siqiervision and 
meetings, types of supportive services provided, case management characteristics, referral services, 
collaborative relationships widi odier agencies, barriers to services, and revenue sources. 

Finally, bodi die Comprehensive Child Development Program (CCDP) and Even Start evaluations 
gadiered information on coordination with other service agencies and case management strategies from 
existing program records and information systems. 

E. PARENT INVOLVEMENT 

Tlie nature and extent of parent involvement in early childhood programs may ultimately affect child 
growdi and development (Education Commission of die States 1988; and Epstein 1987). By involving 
parents in dieir diildren’s early care and education, providers can foster positive parental eiqiectations for 



their children’s development and can help parents enhance the developmental stimulation their children 
receive at home. Some evidence suggests that parent involvement experiences and the receipt of Head 
Start social services in^rove the weU-being of parents, measured in terms of depression, anxiety, and skill 
in dealing with life stress (Parker, Piotrkowski, and Peay 1987). In addition, the stimulation that parents 
provide in the home envir onment may reinforce the positive qualities of the child care setting and may have 
profound effects on a child’s socioemotional and cognitive development, ^proaches to learning, and 
overall readiness for school. 

1. Attributes of Parent Involvement 

We examine six attributes of parent involvement: (1) parent participation in the classroom, (2) parent 
involvement in parent-education activities, (3) parent involvement in program decision making, (4) parent 
interaction with other parents, (5) parent ^proaches to child development in tiie home, and (6) parent 
interaction with staff and other co mmunit y members. Parent involvement enconqiasses involvement by 
mothers, fathers, and other family caregivers and has been a cornerstone of the Head Start program since 
its inception (Ellsworth Associates 1995; Lamb Parker, Piotrkowski, Horn and Greene 1995; U.S. 
Department of Health and Human Services 1984). Participation in the program allows parents to relate 
to their child’s experiences, observe their child’s interactions with other children and adults, leam from 
child care professionals, serve as volimteers, and visit classrooms. Parent involvement in educational 
activities designed for parents includes participation in education programs, workshops, counseling 
services, and staff visits to their home. 

Head Start programs also encourage parent involvement by providing a forum through which parents 
can actively and directly participate in program decision making that relates to the nature and quality of 
their child’s care and education. This involvement includes participation on Head Start policy councils and 
a variety of other program committees. 
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Through active involvement in the program, parents may also become better acquainted with each 
odier, thereby forming fiiendshqrs and potentially strong, supportive relationships with each other. When 
parents interact positively and develop secure relationships with each other, drey may become more 
involved in their child’s development and more interested in the values and goals of the Head Start 
program. Fdihermore, the existence of stqrportive relationships among parents may stqrport the 
development of parenting skills, encourage greater continuity in parenting practices, and foster a sense of 
community among program famihes. 

The nature of the parent’s tq)proach to child development in die home reflects the role of parents as 
the primary educators of their children. It includes a number of key components; parent-child interactions, 
developmentally ^propriate learning activities and materials, parenting skills and disciplinary techniques, 
and parent attitudes and eiqiectations toward children. To meet the needs of parents and families, program 
staff must develop open and regular channels of communication with parents. This involves frequent 
caregiver-parent interactions, teacher-parent meetings, visits to parents’ homes by staff members, contact 
through case management techniques, and the existence of an “open-door^’ visitation policy in child care 
centers. Through frequent interactions, teachers and parents can discuss topics and exdiange ideas relating 
both to parenting and to early care and education practices and can develop positive relationships with each 
other. Teachers thus can encourage parents to develop sound parenting skills and to interact with their 
children at home in positive and developmentally q)propriate ways. When teachers’ values and practices 
on child development and teaching are relatively consistent with parents’ values and practices on child 
development and parmting, the child’s experience in the home can better reinforce his or her erqreriences 
in the program, and vice versa 

The importance of parent involvement for Head Start program practices provides a strong rationale 
for measuring aspects of it in studies of early childhood program environments. Although Uttle empirical 
Hata exist on the relationsh^s between measures of parent involvement in Head Start and child outcomes. 
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a number of studies of child care centers or family child care arrangements have demonstrated that parents’ 
approaches and attitudes toward child-rearing have important implications for children’s development. 
For instance, one study of children in center-based care revealed that children whose mothers placed a 
higher value on their children’s prosocial skills scored higher on tests of cognitive performance and 
language development (Kontos 1991). In addition, an examination of children in family child care homes 
found, after controlling for the quality of care, that children from famihes that were more nurturing, less 
restrictive, and less stressed had higher levels of competent play with adult caregivers, peers, and objects 
(Howes and Stewart 1987). 

2. Instruments for Measuring Parent Involvement 

Studies have gathered data primarily through interviews, self-administered questionnaires, and (in 
some cases) observations in the home. Table n.4 summarizes the six key types of parent involvement 
variables collected in the studies we reviewed. Two of the observation instruments (ECERS and the 
Assessment Profile) have items appropriate for this dimension of quality. ECERS includes an item 
measuring program provisions diat involve parents and foster communication with them. The Assessment 
Profile includes a number of items concerning parent-teacher communications and interactions. Although 
diese are part of the observation instruments, instructions direct the observer to obtain this information by 
interviewing teachers or directors if there is no opportunity to observe the interactions. For many research 
purposes, collection of these items fiirough surveys is most appropriate and cost-effective. 

For the OSECP study Layzer et al. (1 993) used a survty interview format to ask administrators and 
teadiers about die level of parent participation in the classroom and program and the level of staff-parent 
interaction. Questions focused on parent volimteering in the classroom, education and training activities 
for parents, home visiting, participation on program committees (such as staff selection, fimd-raising, and 
budget review), and teacher-parent conferences and communications. 
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Questions in Ae PCCS stucty focused on die ways in ^^tech parents were involved in die program and 
how they interacted widi staff members (Kisker et al. 1991). Specifically, questions dealt widi parent 
volunteering, classroom visits, attendance at workshops or classes in die center, frequoicy and extent of 
home visits, parent interaction widi odier parents, frequency and extent of teacher-parent meetings, and 
parent pardc^aiion in program operations through activities such as committee involvement, selection of 
staff members, and iiqiut into curriculum decisions. 

In the NTS, Love, Logue et aL (1992) collected information from school administrators on die extent 
to which schools provided opportunities for die following elements of parent involvement: parent 
volimteering in die classroom, participation in education workshops, home visits, participation on 
committees, teacher-parent meetings, and at-home learning activities diat siqiport program goals. 
Questions from diese studies could be adapted for Head Start and odier preschool programs. 

The Head Start FSC demonstration hoped to find effective ways to help parents overcome problems 
relating to illiteracy, substance abuse, and unenqjlqymenl FSC views diese three areas as often restric ting 
die abihty of parents to become self-sufficient and to provide a nurturing and s timulating home 
aivironment for dieir children. The FSC evaluation collected detailed information using a baseline and a 
fbUow-up parent interview and questionnaires completed by project directors and case manag ers on diese 
topics: parent participation in classes and trainings, parent use of services, parent-staff interactions, case- 
management-related . communications and activities, and parent r elationship s with individuals and 
organizations within the community. 

Tbrou^ interviews widi parents and direct observations (bodi at die program site and in the home), 
the CCDP evaluation collected information on many dimensions of parent involvement, including 
participation in early childhood services, healdi care services, parent activities, and case management ; 
interactions among parents, program staff, and case managers; and parenting skills (disciplinary mediods, 
attitudes, and eiqiectations). Sev^ questions were achqited from the Home Observation for Measurement 
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of tile Environment (HOME) Inventory (Caldwell and Bradley 1 984) and Home Screening Questionnaire 
(JFK Child Development Center 1981). Using the Child Status Interview, observers also assessed the 
nature of mother-child interactions for children through age 3 (St. Pierre, Goodson, Layzer, and Bernstein 
1994). 

Die Evai Start evaluation used extensive measures of parent involvement. Diey focus on activities 
and services offered to parents; parent-staff interaction; parents’ role in their child’s development in the 
home; activities in the home involving books and reading; teaching and participation in child learning 
activities; encouragement of child creativity; expectations and attitudes toward children; level of frustration 
with child’s attention demands; and involvement with community organizations, support networks, schools, 
and child care providers. Die parent interview borrows questions from several existing instruments to 
measure the nature and quality of parent-child interactions in the home. Diese include the HOME 
Inventory (Caldwell and Bradley 1984), the High/Scope Home Environment Scale (Deloria, Love, 
Goedinghaus, Gordon, Hanvey, Hockman, Platt, and Nauta 1974), and tiie Parent as a Teacher (PAAT) 
Scale (Strom 1984). 

Our goal is to recommend measures previously used in large-scale studies. It may be possible, 
however, to siqiplement tiiese measures with new instruments that contain items pertinent to attributes of 
parent involvement, such as the parent’s relationship with the program, tiiat have not been as widely 
measured in the major studies we reviewed. Howes, Kontos, and Galinsky (1995), for example, have 
developed the Perceived Relationship Scale tiiat asks parents to rate the perceived emotional support, trust, 
general accessibility, helpfulness, and supportiveness of program staff. 



F. SUMMARY 

We have described a conceptual framework for measuring tiie quahty of Head Start and other early 
childhood program environments in terms of five key dimensions: (1) the dynamic nature of children’s 
interactions and activities in the classroom; (2) structural features of tiie classroom such as space and 
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organization; (3) staff characteristics such as education and training, e}q)erience, salaries, and turnover; 
(4) administration and stq)port services such as program director qualifications, staff coordination and 
assessment, and program characteristics and services; and (5) parent involvement in the classroom and 
program, parent interacbons with odier parents and staff, and parent approach to child development in the 
home. We discussed numoous standardized instruments that have been used successfully for describing, 
coding, and classifying inqxjitant interactional and structural features of classroom environments. We also 
discussed several large-scale studies that have developed survey instruments to interview caregivers, 
administrators, and parents about various contextual aspects of progrzun environments. 
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III. FINDINGS AND IMPLICATIONS FROM LARGE-SCALE 
STUDIES MEASURING EARLY CHILDHOOD 
PROGRAM ENVIRONMENTS 



Himdreds of studies have measured aspects of early childhood program environments. For iuture 
research purposes, however, we can learn most from studies diat (1) were implemented in multiple sites 
widi a large sample of programs, (2) involved Head Start programs (or programs diat share many of die 
characteristics of Head Start), and (3) collected data on die program dimensions diat we described in die 
last ch^ter. We reviewed 1 1 studies diat met diese criteria. Appendix A contains brief summaries of 
these studies, and Table m. 1 highhghts these features of each study; (1 ) date conducted, (2) purposes of 
die study, (3) types of programs studied, (4) populations die programs served, and (5) study design and 
sample. In this ch^ter, we summarize die findings from each study diat may be useful for guiding 
decisions about instruments to use in future research. We present the findings and implications diat pertain 
to measuring die dimensions of classroom dynamics, classroom structure, staff characteristics, 
administration and support services, and parent involvement. 

A. FINDINGS AND IMPLICATIONS FOR MEASURING CLASSROOM DYNAMICS 
1. Summary of Findings 

Six of the studies produced findings with implications for measures of classroom dynamics. The most 
recent of the Head Start observational studies, die Observational Study of Early Childhood Programs 
(OSECP), reached four key conclusions related to classroom dynamics; (1) die amount of adult-child 
interaction was greater, and global measures of classroom quality were higher, i^iien child-staff ratios were 
lower (fewer childroi per staff member); (2) teachers spent more time interacting widi children, teaching 
children, teaching language/number concepts, and using positive techniques i^iien diey were more highly 
educated; (3) teachers spoit more time teaching and interacting widi individual children in classrooms diat 
involved a m^ority of parents in several different types of activities; and (4) classrooms were rated higher 
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HIGHLIGHTS OF LARGE-SCALE STUDIES MEASURING EARLY CHILDHOOD PROGRAM ENVIRONMENTS 
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Year(s) of Data Major Purpose(s) Types of Programs Studied Populations Served Study Design and Sample Description 

Collection 



iO 



u 







I 






SO 

ft 



fill 

hil. 

lllH 
ssj| 
§■" 
os *T* so 3 

° fe 8 -I 






a 

■f 

j g « 

«i* 



iJi -J 

3 ^ « C 

u «= = 8« 

S 'g .SP's c 

bU ^ M C rT 

2 a 8^^ 

c: j £ u a 

o 2 S S» 8 
o <5 S u. -s 

fllll 
III g| 



E 

S 

.1 £ 

0 *c c 

1 -I "e 

(5 Q.J> 

I a J 2 

E 

:s 's M «> 
§ 8 ^ 
U vS L a. 






g:S:i:^ 





— S o o ij y 

i 'S 3 S eo 
«2 ^ a T? «* c 



e ^ .S C os ¥?:«: 

2 2 S *? 8^ 

2 3 s g *s 

ll g. 



) c "O 

-ill i 

sill. I 
S g-s I i 



5 



*C 

& 

t 

<N 

Ov 

Ov 



•c 

a 

eo 







best copy available 



on use of developmentally ^propriate activities when teachers were more highly educated and trained. 
Although the OSECP findings caimot be generalized to all early care and education programs, they are 
particularly relevant to Head Start r^earch because (1) they are based on a relatively large sample of 
programs; (2) the programs included a sizable san^le of Head Start classrooms; and (3) the children 
served in all programs represent a population similar to diat served by Head Start. 

OSECP showed that global measures demonstrate adequate reliability in their internal consistency and 
that they measme many facets of classroom dynamics that are inqiortant elements of effective early 
childhood program practice. Scores on three of the m^or global measmes (ECERS, Assessment Profile, 
and CPI) were so highfy correlated, however, that using all three provides redundant informahoa Another 
global rating instrument, the Arnett Scale, captures inqjortant qualities of teacher affect and style, 
especially “teacher responsiveness,” that the other global ratings do not measme. 

Micro-observational mediods are useful for capturing behavior interactions that underhe the dynamic 
processes of early childhood classrooms, but these mediods would be prohibitively e7q>ensive to implement 
in large national studies. Furthermore, all four global instruments were significantly correlated with many 
of the micro-observational measmes of quality, suggesting that the microdata are not essential for 
understanding in^ortant early childhood classroom dynamics. 

The California Staff/Child Ratio (CSCR) study reached two important conclusions relating to 
classroom dynamics; (1) children spent less time uninvolved and exhibited lower levels of stress behavior, 
and caregivers acted in a more attentive and encomaging maimer, in classrooms with more 
developmentally ^prOpriate practices; and (2) children exhibited low levels of negative behaviors when 
there was a supportive learning environment and \^iien teachers treated children in a positive and 
individualized manner. The CSCR study further demonstrates diat global measmes of quality (in this case, 
the Assessment Profile, Arnett Scale, and CPI) can be used reliably in a large multisite study. 
Fuidiermore, the CSCR study documented inqxrrtant links between classroom dynamics and other quality 
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elements. It demonstrated that developmentally q}propriate practices are important because they relate 
to caregiver interaction styles and children’s behavior. 

The findings fium the NCCS study, alfiiough not based on a representative sample of early care and 
education providers, provide a wealfii of information on die characteristics of center-based child care 
teachers and caregivers. Several key conclusions relate to classroom dynamics: (1) teachers provided 
more appropriate and sensitive caregiving when fiiey had received more formal education and early 
childhood training at die college level and when diey earned higher wages and benefits; (2) teachers and 
children interacted in a more positive and prosocial maimer when the child-staff ratio was lower; and (3) 
children who attended centers widi greater staff turnover and lower levels of quality were less competent 
in social and language development Thus, important links between children’s development and caregiver 
behaviors and education were documented in a large-scale national study. 

The Head Start Family and Classroom Correlates Outcomes (HSFCC) study reached several kqr 
conclusions relating to classroom quality:' 

• Children’s cognitive and pre-academic skill development was higher, controlling for die 
quality of a child’s home envirorrment, when children attended higher-quahty classrooms. 

• Children from more stimulating home envirorrments, compared wifii children fi’om less 
stimulating environmoits, benefited more fiom classrooms that had a high-quahty curriculum 
in problem-solving and reasoning skills. 

• Children scored hi^er on verbal skills, information processing, and pre-academic skills when 
thty attended higher-quality Head Start classrooms; however, teachers’ ratings of children’s 
behavioral and social skills were not associated with classroom quality. 

• Only nine percent of die Head Start classrooms received a mean ECERS score of S or better, 
die level that indicates “good” developmental practice according to die ECERS audiors. This 
conqiares widi die CQCO study’s finding of 14. 1 percent of classrooms scoring S or better, 
and OSECP’s finding that 29 percent of classrooms had scores of S or better. 




'HSFCC analyzed total ECERS scores, so the quality measure did not distinguish between the dynamic 
and structural items. 
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CQCO concluded that more than half of the child care centers examined failed to meet children’s 
needs for learning and warm relationships. Controlling for maternal education and child gender and 
race/edmicity, children displayed greater receptive language abihty, higher levels of pre-mathematics and 
social skills, and more positive attitudes toward themselves A\hen they attended higher-quality preschool 
classrooms. Unlike some research, CQCO fotmd no significant differences between noiq^rofit and for- 
profit centers in the quahty of classroom dynamics. 

The NTS demonstrates die feasibility of conducting a large-scale mail survey of public school districts 
and schools. The self-reported data provided a useful description of kindergarten classroom practices, 
indicating the prevalence of developmentally in^propriate activities mixed with developmentally 
^propiiate practices. The NTS also demonstrates the possibility of collecting comparable preschool- and 
kindergarten-level data on classroom practices using survey mediods. 



2. Implications for Future Research 

Collectively, diese studies demonstrate diat it is possible to collect both global measures of classroom 
dynamics and very detailed micro-observations in a large-scale, multisite national study. Obtained this 
way, measures are reliable and ^pear to be valid in that diey are related to each other and, in some cases, 
to child outcomes. The findings of die studies suggest diat priority in the area of classroom dynamics 
should be given to measuring (1) global classroom quahty, (2) instructional practices indicative of 
developmentally tqipropriate or intqipropriate activities, and (3) different types and characteristics of 
caregiver behavior. We see six specific implications for measuring program environments; 



1. Classroom dynamics are critical features of program environments because many of their 
attributes relate to children’s behavior and well-being. 

2. The most widely used global measures (ECERS, Assessment Profile, and CPI) are fairly 
highly correlated with each other. Their results are not totally redundant, however, if one 
examines subscales. For exanqile, even though Layzer et al. (1993) report high correlations 
between total scores on the ECERS and the Assessment Profile, Abbott-Shim, Neel, and 
Sibley’s (1993) analysis of subscale scores showed that the scheduling and interacting scales 



O 

ERIC 



37 



55 



of the Assessment Profile are not highly correlated with ECERS subscale scores and may be 
measuring different aspects of classroom dynamics. 

3. One of the global measures (the Amett Scale) is among die easiest to use and c^tures 
aspects of teacher-dbild interactions that the other global measures do not. Ratings of teacher 
bdiaviors such as attentiven^, encotiragement, warmfii, and detachment are associated with 
positive child well-being. 

4. Micro-observational mediods tiiat c^ture teacher-child interactions in greater detail have 
intuitive ^peal but would be prohibitively e^qtensive to conduct in very large studies. 
Furthermore, the global measures have been shown to be substantially correlated with scores 
from the micro-observations. 

5. Self-rqx>rted data on classroom practices may be a useful stq)plement to observation-based 
measures (but catmot substitute for direct observations). 

6. The increasingly wide use of a core set of global measures of classroom dynamics ensures 
that researchers will be able to make comparisons witii other studies. 



B. FINDINGS AND IMPLICATIONS FOR MEASURING CLASSROOM STRUCTURE 
1. Summary of Findings 

The measures used in OSECP encompass many inqiortant aspects of classroom structure, as defined 
by the NAEYC guidelines. As witii tiieir measures of classroom dynamics, tiiese instruments demonstrate 
adequate internal consistency. OSECP reached two key conclusions relating to classroom structure; (1) 
tile amount of adult interaction witii children was greater and global measures of classroom dynamics 
indicated higher quality i\4ien child-staff ratios were lower (fewer children per staff member); and (2) 
compared with child care and Ch^ter 1 classrooms in the study. Head Start classrooms had much lower 
child-staff ratios and were less likely to have only a single adult si^ervising children for a substantial 
period of time. Furtiiermore, conqiared with other program types. Head Start classrooms were highly rated 
and had more consistoit levels of quality, measured by such indicators as physical space, equipment, and 
safety. The findings suggest that classroom structure variables, particularly the child-staff ratio, are equally 
important in Head Start as in child care and Ch^ter 1 programs for 4-year-olds. While OSECP did not 
measure child outcomes, it did demonstrate essentially the same degree of association between tiie 
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classroom structure and classroom dynamic variables as in odier studies that have found associations with 
child outcomes (for example, die CQCO and NCCS studies). 

As with OSECP, the CSCR study showed how classroom structure is associated witii the quality of 
classroom dynamics. First, children were more likely to spend time in large groups and be less involved 
in activities w^en child-staff ratios were higher. Second, classrooms were rated as more developmentally 
^ipropriate, in terms of instructional activities and caregiver-child interactions, \\hen diey achieved higher 
ratings on structural dimen.«dnn.«; such as safety and health, as measured by the Assessment Profile. Thus, 
CSCR documented moderately strong associations between classroom structure and program dynamics. 
CSCR also showed that ratios and class sizes reported by programs are somei^hat larger dian those 
calculated by the trained observers using the PCS. 

The NCCS study reached two key conclusions relating to classroom structure; (1) teachers and 
childrai interacted in a more beneficial manner vhen the child-staff ratio was lower; and (2) higher-quality 
centers, in terms of classroom dynamics, were more likely to have lower child-staff ratios. 

The pees stuefy is unique because it developed a statistical profile of the population of early care and 
education providers in the United States. It reached several main conclusions relating to classroom 
structure: (1) group sizes and child-staff ratios increased from the late 1970s to 1990; (2) in 1990, average 
group sizes and child-staff ratios were in the middle to upper end of die recommended ranges of group 
sizes and ratios; and (3) in group sizes and ratios, the quality of care provided by programs serving low- 
income children is conqiarable to the quality of care provided by other programs. The NTS demonstrated 
an important correlate of structural variables, child-staff ratios were lower v^en the poverty level of the 
school was higher. 



2. Implications for Future Research 

Althn ug)i variables describing classroom dynamics (discussed earlier) are most likely to affect child 
development and well-being, some studies find elements of classroom structure to be significandy 
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correlated with dynamic variables. Thus, it is inqx>rtant for research studies to include, at a minimum, data 
on child-staff ratios in classrooms, as well as data on groiq) sizes. The extent to which a classroom 
environment promotes children’s safety and health is also a key element of quahty that should be 
considered for inclusion in the data collection design. Structural features (such as child-staff ratios) are 
relatively easy to measure using survey instruments. Studies such as the PCCS and NTS demonstrate that 
computer-assisted telephone interviews and self-report mail surveys, respectively, can provide diis 
information. The data from these sources, however, will differ from the data obtained by classroom 
observatioiL If resources permit, it would be best to obtain this information by observation, sampling 
across multiple time periods. 

C. FINDINGS AND IMPLICATIONS FOR MEASURING CLASSROOM STAFF 
CHARACTERISTICS, ADMINISTRATION AND SUPPORT SERVICES, AND 
PARENT INVOLVEMENT 

1. Summary of Findings on Staff Characteristics 

OSECP examined the influence of staff characteristics on the quality of care and found diat teachers 

who had higher levels of education (as measured by the level of degree or certification) spent more time 

interacting widi children, teadiing children, and teadiing language/number concepts. They also used more 

developmentally appropriate activities. In addition, children in classrooms led by more-highly educated 

and trained teadiers spent more time engaged in activities with goals. In Head Start classrooms, however, 

teacher education lacked the same degree of influence. In Head Start classrooms, teachers tended to rely 

more on training opportunities (including CDA certification) conq)ared with teachers in other classrooms. 

The finding that die “level of teadier education’’ and die “level of specialized education or training in early 

childhood education’’ were highly related indicates that it may be possible for teachers to realize some of 

the benefits of higher education by attoiding the types of preservice and in-service training diat Head Start 

provides, including CDA cerdficadon. Tlie CSCR stucfy found that classrooms vdiose caregivers had more 

training in early childhood educadon were rated higher on developmentally tqipropriate pracdces. 



In addition to examining the relationship between staff characteristics and quality of care, the NCCS 
reached four conclusions related to staff characteristics: (1) child care teachers generally have attained high 
levels of formal education but earn relatively low wages (as a reflection of this, staff turnover rates nearly 
tripled from 1977 to 1988); (2) teachers tend to provide higher-quality care and services to children, as 
measured through “^propriate and sraisitive caregiving” on the Arnett Scale, when they have had more 
formal education, received more early childhood training at the college level, and earn higher wages and 
benefits; (3) children were more conq^etent in social and language development \^fren they attended centers 
wifo lower staff turnover, and (4) higher-quality centers paid staff better, and also had a better adult work 
environment, lower teacher turnover, and a more-highly educated and trained staff. 

The PCCS reached several key conclusions that relate to teachers, caregivers, and other staff 
members: (1) ^roximately half of center-based teachers have graduated finm college, and nearly all have 
received child-related training (teachers in public-school-based programs are more likely to have a college 
degree); (2) the annual rate of teacher turnover is 25 percent; (3) given foeir level of education, preschool 
teachers earn very low wages, alfoough teachers in public-school-based programs earn significantly higher 
wages than teachers in ofoer types of programs; and (4) the racial/ethnic composition of the staff generally 
reflects foe race/ethnicity of foe children in care. The HSFCC study is one of foe few studies to find only 
a weak relationship between foe level of teachers’ educational at tainment and classroom quality, as 
measured by foe mean ECERS score. 

The CQCO study demonstrated that many staff characteristics are important correlates of classroom 
quality. After examining educational level, experience, relevant training, wages and benefits, turnover (or 
staff tenure), and leadership ability, foe CQCO study concluded that foe quality of children’s classroom 
ejqjerience (measured by foe ECERS) was higher whai staff members had a college education (bachelor’s 
degree) and staff turnover was less frequent Wages, education, and training all distinguished poor-quality 
centers finm mediocre-quality ones. Staff working in nonprofit centers, compared wifo those in for-profit 
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centers, typically earned higher wages; among nonprofit centers, church-affiUated centers typically had 
staff widi less training and education and paid lower wages. 



2. Summary of Findings on Administration and Support Services 

The NCCS study demonstrated diat (1) higher-quality classrooms shared die following attributes 
related to dieir program’s location, administration, and support services; better adult work environments, 
noiqirofit status, accreditation dirou^ die NAEYC, and location in states widi higher standards for quality; 
(2) conqiared to dieir for-profit counterparts, nonprofit centers (non-church-affiliated) received a smaller 
percentage of revenues from parent fees and a larger percentage from government funds and served a 
hi^er percentage of subsidized children; (3) charitable funding represented tqiproximately seven percent 
of child care center revenues; (4) nonprofit centers (bodi diose diat did and did not receive government 
funds) provided more developmentally appropriate care dian odier center types; (5) parents paid higher 
fees in centers widi more ^piupiiate and higher-quality caregiving; and (6) low-income children generally 
attended higher-quality centers than middle-income children, largely because of subsidies diat helped 
defray die costs. 

The PCCS generated a number of important insights into die administrative and support service 
characteristics of child care providers; (1) approximately 13 percent of all center-based programs offer 
pltysical examinations, and tq^proximately 40 percent offer testing for cognitive and social development; 
(2) nearly 75 percent of all Head Start programs provide physical examinations, and nearly all Head Start 
programs offer cognitive developmental testing; (3) jq^proximately 85 percent of center-based providers 
charge some level of parent fees; (4) parent fees as a proportion of total revenues have increased since die 
late 1970s, while government funds as a proportion of total revenues have declined; and (5) among 
providers diat charge parental fees, higher-quality programs charge higher fees. 

Hie CQCO study examined a variety of important characteristics related to die financial management 
and administrative characteristics of child care centers. It controlled for die following variables in its 
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analysis of the costs and quality of center-based care: (1) center auspice (nonprofit, for-profit), (2) 
sponsorship (pubhc, independent, church-afGhated), (3) state-hcensing standards, (4) accreditation 
standards, (S) regional variation in standards, (6) composition of revenues and e^qienses, (7) labor and 
facilities costs (including forgone wages of child care staff), (8) cash and in-kind contributions, (9) profit 
margins, (10) fee schedules, (11) administrative leadership and e^qierience, (12) age mix of children 
served, and (13) proportion of subsidized children served. 

The CQCO study found state hcensing standards to be important; states with higher hcensing 
standards had a smaller proportion of poor-quahty centers. Centers required to meet higher standards 
typically paid higher wages, provided better benefits, and offered a higher quahty of care than centers that 
did not meet regulatory standards. In addition, accredited centers typically provided a higher level of 
quality care. 

High-quality centers shared the following characteristics; higher costs and revenue per “child hour,” 
more donated resources and outside funding, and lower parent fees as a proportion of total revenues. In 
their CQCO study, the Cost, Quahty, and Child Outcomes Study Team (1995) estimated that centers 
would need to spend an additional 10 percent to improve their quahty of care from “mediocre” to “good.” 
They also examined the level of the center administrator’s e?q)erience and found that, all else held constant, 
an increase in experience is associated with higher quality care.- 

3. Summary of Findings on Parent Involvement 

The PCCS produced several findings concerning the extent of parents’ involvement in the early care 
and education programs of their children. It foimd that (1) almost three-quarters of the centers reported 
regtilar teacher-parent meetings; (2) approximately one-quarter of the centers have staff members ^\fio 
make home visits to meet with parents; and (3) more than one-quarter of all centers reported that parents 
serve as classroom volunteers, \^iiile close to 90 percent of Head Start programs reported that parents serve 
as classroom volunteers. Parent involvement depends on the nature of the activity. Nearly half of the 
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centers reported that parents participate in fund-raising activities, ^^iiereas fewer than one-quarter reported 
parent involvement in budget review. Only 1 6 percent reported parent participation in staff selection, but 
tqjproximately two-fiflhs reported parent attendance at workshops and classes. Head Start programs were 
much more likely than other center-based programs to involve parents in these ways. 

The OSECP concluded that, ^^en the level of parent involvement was high, overall classroom quality 
was higher, and teadters were more involved with duldroi and gave them more individual attention. High 
parent involvemoit indicated that there was a 75 percent participation rate in at least three of the following 
parent activities; volunteering in the classroom, volunteering on field trips, making materials, sharing skills, 
attending parent/teacher conferences, attending social events, and recruiting families for the program A 
greater percentage of Head Start classrooms (compared with the other types of classrooms) involved a 
greater percoitage of parents in each of the seven parent activities, and a smaller percentage of Head Start 
classrooms had activities in A^ch no parents participated. The study acknowledged diat in-person 
observation of children and parents would enhance the tmderstanding of how parent involvement affects 
child development. 

The CCDP evaluahcxi found that CCDP mothers (compared with control grotp mothers) were (1) less 
likely to report attitudes that can be linked to child abuse and neglect; (2) more likely to have higher 
expectations for their child’s success in school; (3) more likely to report spending time with their child and 
to report that resident fathers spent more time in daily activities with the child; and (4) more likely to act 
in a responsive, sensitive, and developmentally appropriate mann er toward the child. 

4. Implications for Future Research 

Many of the attributes measured in these three dimensions of the program environment are inqx>rtant 
in Head Start program operations. Furthermore, the measurement of staff characteristics, administration 
and support services, and parent involvement can be readily accon^)lished using telephone or in-person 

interviews. Thus, data on these aspects of Head Start children’s program environments would be a 
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valuable part of future research. The findings of diese studies su g gest that consideration should be given 
to measuring die following attributes: 

• Level of educational attainment of classroom teachers and aides 

• Extent of staff specialized training in child development and early childhood education 

• Turnover rates among teaching staff (bodi teachers and aides) 

• Wages or salaries of classroom staff 

• Racial/edinic composition of classroom staff in relation to the race/edinicity of the children 

• Parent participation in the program for children 

• Parent involvement in parent education activities 

• Parent involvement in program decision making 

• Supportive relationships among parents 

• Parent-teacher relationships 

• Relationship of teacher and parent values to teaching and parenting practices 

• Qualifications of program director/administrator 

• Staff satisfaction with the work environment and input into program decisions 

• Administrative characteristics such as sponsorship, accreditation, and licensing 

Some administrative variables found to be linked to classroom quality in studies of child care and non- 
Head Start preschool programs are not applicable to Head Start studies. For example, parent fees and 
child subsidies are not relevant variables, since Head Start parents pay no fees. Some aspects of program 
costs (such as staff wages) may be important, however. Studies should measure aspects of parent 
involvement Although its association witii the quality of classroom dynamics or structure is weak, parent 
involvement is central to tiie goals of Head Start and many other early childhood programs. It is important 
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to leam, using a larger and more representative sample dian in the OSECP, whether different types of 
parent involvement are related to (1) program quahty, and (2) children’s development and learning. 



D. SUMMARY 

The findings from the Head Start and early childhood studies reviewed here suggest that future 
research studies should give priority to measining certain aspects of classroom and program environments. 
In terms of dassioom t^namics, it is particularly in^ortant to measure global classroom quality, caregiver 
behavior, and instructional practices indicative of developmental appropriateness. In terms of classroom 
structure, priority should be given to measuring grotq> sizes and child-staff ratios in classrooms. Finally, 
in terms of staff characteristics, administration and support services, and parent involvement, we suggest 
a number of variables diat would be inqx)itant to measure and would serve as valuable additions to future 
research efforts. 
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IV. RECOMMENDED FRAMEWORK FOR ASSESSING EARLY 
CHILDHOOD PROGRAM ENVIRONMENTS 



In this paper, we selectively reviewed researdi on five dimensions commonly used to describe features 
of early childhood programs that m^ influence the development and well-being of the enrolled children; 

1. Classroom dynamics 

2. Classroom structure 

3. Classroom staff characteristics 

4. Administration and support services 

5. Parent involvement 



We selected studies that focused on Head Start programs, or programs serving a similar low-income 
population, and concentrated on describing instruments that either have been used in Head Start programs 
or clearly would be ^propriate for them. Hie studies we reviewed in Chapters II and m are part of a large 
body of research that now exists on measuring program environments and an increasingly large number 
of studies of program quality. The findings and measurement procedures of these studies have important 
implications for decisions about measuring program environments in future Head Start and other early 
childhood program research; what to measure, and how to conduct the measurements. 

These studies demonstrate that (1) it is important to measure children’s program environments 
because variations in a number of quality dimensions are associated with important aspects of children’s 
development and well-being, (2) multiple dimensions are required to assess adequately the full spectrum 
of program quality, and (3) methodologies for assessing the quality of program environments now exist 
that can be implemented economically on a large scale. 

Although we could use hundreds of variables to describe fully children’s e7q)eriences in early 
childhood programs, research demonstrates that researchers can obtain a reliable and valid portrait of the 
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most important ejq)eriences by using a few carefully diosen measures. As Scarr et al. (1 994, p. 132) have 
noted, research “does not require exhaustive inventories but rehable and valid measures of diose aspects 
of quality that can be assessed widi efficiait and ineiqiensive measurement.” This conclusion is supported 
by die relatively strong correlations observed among many of die global measures and between the global 
and micro-observadon measures. The conclusion of Scarr et al., however, ^phes to die limited set of 
vanables diey studied; die ECERS (or die in^t-toddler version), die Assessment Profile, child-staff ratio, 
group size, teacher training, teacher education, highest wage, and staff turnover. To address die large 
number of program issues related to Head Start programs, variables representing all five dime n.«; ion s 
reviewed here would have to be included. 

We summarize our recommendations in Table IV. 1 and discuss diem in die following sections. All 
of die observational data can be collected by trained observers spending a single three- to four-hour 
observation period in each classroom. All of the observation instruments we recommend have been used 
in multisite studies in vduch large numbers of observers have been trained to meet reliability standards. 
The items recommoided for inclusion in parent, teacher, and director interviews have been used in large- 
scale telephone and/or in-person interview formats with national samples, as summarized in Chapters II 
and m. 



A. CLASSROOM DYNAMICS 




By selecting two or three widely used global measures, researchers will be able to assess key 
attnbutes of classroom dynamics that are commonly used to indicate quahty programming for children and 
for which evidence suggests at least an association (if not a causal relationship) widi children’s 
developmoit and well-being. We recommend the ECERS because it is tiie most widely used measure of 
global quahty and yields scores that have been correlated with child outcomes in many studies. As 
suggested by Scan et al. (1994), researchers could consider selecting a subset of ECERS items, focusing 
on two dimensions that Whitebook et al. ( 1 989) found important; (1 ) developmentally qipropriate activity, 
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TABLE rV.l 



RECOMMENDED EARLY CHILDHOOD CLASSROOM AND PROGRAM ENVIRONMENT 

VARIABLES AND MEASURES 



Variables 



Measures 






Global Quality Subscales of Early Childhood Environment Rating Scale 

Developmentally appropriate activity 
^rpropriate caregiving 



Instructional Practices Adaptation of Classroom Practices Inventory (modified as 

Developmentally appropriate D^lopmental Practices Inventory) 

Developmentally inappropriate 

Caregiver Behavior Subscales of Arnett Scale of Caregiver Behavior 

Watm/responsive (or attentive and encouraging) 

Harsh/punitive (or harsh and critical) 

Detached 



Child-Staff Ratio 



Observatioiud counts 



Group or Classroom Size 



Observatioiud counts 



Safety and Health Subscale of Assessment Profile 

Safety of classroom 
Safety of supphes and materials 
Teacher preparation to respond to accidents and 
emergencies 

Encouragement of personal hygiene 



Teacher responsibility for basic health care 

■••• • - N- •• •: ^ v. • .-.w.v. 

Oatwo^Slaiircniflncterifticft : 









Staff Education and Training Teacher interview 

Description of degrees received 
Receipt of Child Development Associate credentials 
Types of training classes and workshops in child 
development and other relevant areas 



Staff Turnover Rate Program director interview 

Number of lead and other teachers who have left the 
program in past 12 months as a proportion of all 
teachers 



Wages and Salaries Program director interview 

Wages/salaries of classroom staff members by role 
Volunteer classroom staff 

Racial/Ethnic Composition of Classroom Staff and Program director interview 

Volunteers in Relation to Racial/Ethnic Composition of 

Children 
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Table rV.l (continued) 



Variables 


Measures 


J ^ ^ . AdtalBi*tm6«a«adSH|^rtS«rrtces. 


Qualifications of Progiam Director/Administxator 
Degrees received 
Years of eTqperience 
Types of prior experience 
Relevant training courses 


Program director interview 


Work Environment 

Stafif satisfaction with different working environment 
characteristics 

Involvement by teachers and staff in program 
management and program decision making 


Teacher interview and program director interview 


Administrative Characteristics 
Sponsor of program 

Accreditation (for example, by NAEYC) 


Program director interview 


Schedule 
Hours per day 
Days per week 
Weeks per year 


Program director interview 


' " ' "" ' 


Parent Participation in Classroom 
Volunteering in classroom 
Classroom visiting 


Parent interview and teacher interview 


Parent Involvement in Parent Education Activities 
Participation in workshops and programs 
Home visits 


Parent interview 


Parent Involvement in Decision Making 
Participation on program committees 


Parent interview and program director interview 


Parent Approach to Child Development in the Home 
Parent-child interactions 

Developmentally appropriate activities and materials 

Parenting skills and disciplinary style 

Parent attitudes toward and expectations of children 


Parent interview 


Supportive Relationships Among Parents 


Parent interview 


Staff-Parent Interaction 
Teacher-parent meetings and interactions 
Relationship of teacher values and practices to parent 
values and practices 


Parent interview and teacher interview 
Parent interview, teacher interview, and program director 
interview 
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and (2) ^propriate caregiving. We also recommend using an adsqjtation of die CPI. This will enable 
researchers to differentiate the aspects of classroom dynamics that constitute curriculum activities. We 
bdieve die CPI requires further ad^tadcms (b^^ond those used in die OSECP and CSCR studies) for two 
reasons; (1) the early childhood field currendy is reconsidering die concept of developmentally ^propriate 
practices (Mallory and New 1994), and (2) observers must be able to make rehable ratings during 
observadcm periods of reasonable Imgdi (for exanqile, between two hours and one-half day per classroom). 
Using the Arnett Scale, researchers will be able to measure aspects of teacher behaviors (in interaction with 
children) that are not included in the other global measures. The important Arnett scales are (1) “warmth/ 
responsiveness” (or “attentive and encouraging”), (2) “harsh/pimitive” (or “harsh and critical”), and 
(3) “detached.” 

B. CLASSROOM STRUCTURE 

At no additional cost, v^dlile completing these global ratings, observers can also coimt die number of 
adults and children at several points during the observation period so diat they can calculate group sizes 
and child-staff ratios. If more details on children's groupings and activities are desired, researchers could 
create a sinqilified version of die PCS. We also recommend using a subscale from the Assessment Profile 
to measure classroom features relating to safety and health. This instrument requires a relatively small 
amount of time to train observers, provides objective scores on safety and health characteristics, and allows 
researchers to identify programs that score below an acceptable standard of quality in safety and healdi. 

C. STAFF CHARACTERISTICS 

We recommend gathering data on staff characteristics by including questions on this dimension in both 
the teacher and program director interviews. The studies discussed in Chapters II and m included 
questions researchers can draw from to measure a variety of staff characteristics. We recommend die 
collection of information on staff and teacher education and training (including types of relevant degrees 
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received and the receipt of CDA credentials and other relevant training). To collect the most current and 
accurate information, we suggest collecting these data dirough teacher interviews, instead of dirough 
program director interviews. 

In a program director interview, we recommend asking a number of questions diat will permit studies 
to report (1) staff turnover rate (or die percentage of teachers i^o have left die program in die past year), 
(2) average wages and/or salaries of teachers and staff and die percentage of classroom staff wiio are 
volunteers (ac^usdng for time spoit in the classroom), and (3) racial/edinic conqiosition of classroom staff 
in relation to die racial/edinic composition of die children that die program serves. Since both staff 
turnover and staff wages/salaries are key indicators of higher-quality programs, diey are important 
variables to measure. Average and median figures will permit researchers to assess die distribudon of 
wages and salaries among paid staff, and a count of die number of volunteers will allow assessments of 
die extent to which a program relies on volunteer labor. 

D. ADMINISTRATION AND SUPPORT SERVICES 

As with classroom staff characteristics, we recommend using survey interview quesdons, p rimari ly 
in a program director interview, to gather infoimadcm on key facets of administradon and siqiport services. 
As we discussed in Chapters II and m, previous studies have developed quesdons for measuring program 
administration and siqiport services. First, we suggest diat informadon on die qualificadons of die program 
director or administrator be collected by direcdy asking die directors diemselves in die interviews. The 
most meaningful qualificadons include (1) number and type of degrees received; (2) years of eiqierience 
in the early childhood field and related fields; (3) types and years of odier, prior eiqierience; and (4) 
relevant training courses taken. 

To examine the climate of die program environment and die involvement of staff in die overall 
program, we suggest measuring two key aspects of die work environment; (1) staffs reladve sadsfacdon 
widi a variety of aspects of die working environment, and (2) die level of involvement by teachers and odier 



staff members in program management and decision making. We advise including questions on these 
aspects of die work environment in both the teacher and program director interviews to account for any 
discrepancies between the different viewpoints. For program administrative characteristics, we feel that 
die most inqxiTtant variables to measure are die sponsorship of die program and types of accreditation that 
it has received (for example, by NAEYC). These variables crqiture variation among different programs 
and can be easily coUected dirougfi a program director interview. Data on the program’s schedule also can 
be obtained dirough a program director interview. 

E. PARENT INVOLVEMENT 

Active involvement by parents in their children’s early care and education, bodi in the home and 
through participation in the daily program, helps to reinforce the efforts of teachers and staff members. 
As ivith the classroom staff and administration and support service characteristics discussed earlier, an 
extensive portrtyal of parent involvement in Head Start and other programs can be collected using parent, 
teacher, and program director interviews. As we discussed in Ch^ters II and HI, previous studies have 
developed questions for measuring different types of parent involvement in Head Start. We recommend 
measuring a number of key elements of parent participatioa First, questions on both the parent and teacher 
interviews can be used to collect information on the frequency with i^frich parents visit and volunteer in 
the classroom. Similarly, we recommend collecting more detailed information on participation in 
educational activities designed for parents, including workshops, programs, and home visits. Such 
information can be most effectively gathered by querying parents, since diey represent die source of the 
most accurate information on attendance in, and satisfaction wdth, the activities. In addition to involvement 
in parent education activities, it is important to understand the level of parent involvement in program 
decision making. Therefore, we suggest asking both parents and program directors about die level of 
parent participation on program committees. 
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To conq>lement the data on parent participation in the classroom and program, we recommend 
collecting data on the quality of parents’ £q)pioach to child development in the home, their relationships 
with other parents, and their interactions widi teachers and staff members. We recommend diat a set of 
questions be asked of parents to better tmderstand their relationship to and interactions with their child in 
the home. Such questions should measure (1) the level and types of parent-child interactions, (2) the use 
of developmentally ^ropiiate activities and materials in the home, (3) parenting skills and disciplinary 
style, and (4) parent attitudes and expectations of children. To collect information on parent relationships 
widi odier parents, we suggest asking parents a question that characterizes the srqrportive nature of dieir 
relationshqjs with other parents. To gadrer data on staff-parent interaction, we suggest asking both parents 
and teachers about the types and frequoicy of their meetings and interactions. Finally, we recommend that 
a question be asked of pararts, teachers, and the program director about their perceptions of the association 
between teacher and parent values and practices. By asking such a question in all duee interviews, 
researchers can measure the variance in perspectives and gauge die level of consistency between teacher 
values and practices regarding child development and teaching, as well as parent values and practices 
regarding child development and parenting. 
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AND OTHER EARLY CHILDHOOD PROGRAM 
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1. Observational Study of Early Childhood Programs (OSECP) 

The OSECP (Layzer et al. 1993) examined Head Start and other center-based programs that serve 
low-income 4-year-old childreiL The study was designed to (1) define and measure the quality of early 
childhood programs, (2) determine die ways in which classrooms and staff members influence quality, and 
(3) identify die w^ in i^diich overall quahty relates to classroom dynamics. A total of 1 1 9 early childhood 
programs were randomly selected fixnn five sites for die study. The five sites were chosen to ensure a level 
of geographic and regulatory diversity among programs. Observers spent one week in each classroom 
during spring 1991 observing and coding the program environment, including classroom dynamics. The 
OSECP used all of the observation instruments discussed in this paper (the ECERS, Assessment Profile, 
Arnett Scale, CPI, and PCS). In addition, Layzer et al. developed and used the Abt Adult-Focused 
Observation, a micro-observation technique, to characterize classroom interactions in more detail. 

2. California Staff/Child Ratio (CSCR) Study 

The CSCR study examined quah^ in early care and education programs in California by determining 
whether or not the 8:1 child-staflfratio standard could be increased to either 9:1 or 10:1 without dimini.shing 
program quality (Love, Ryer, and Faddis 1992).' Observations were conducted in 112 classrooms 
operated by state-funded child care service agencies that served subsidized 3- to S-year-old children. 
These classrooms were randomly assigned to a new ratio of 8:1, 9:1, or 10:1. Observers spent four half 
days in each classroom collecting data during fall 1990 and spring 1991. 

3. National Child Care Staffing (NCCS) Study 

Influenced by the high rate of staff turnover and the notion that well-trained and consistent staff 
promote quality child care, the NCCS study examined work envirorunents for center-based teachers and 



'Althou^ the CSCR study used the term “staff/child ratio,” we use the term “child-staff ratio” in this 
paper to be consistent with more common usage. 



staff members to determine how work environment affects die quality of care (Whitebook et al. 1989). 
In terms of classroom dynamics, the stu(fy sought to examine (1) die relationship among characteristics 
of teachers and staff members, features of die work environment, and measures of the quality of child care 
provided; and (2) die impacts, if aity, diat standards, accreditation status, auspice, and types of families 
served have ori the quahty of care provided. The stud^ used a random sample of 227 child care centers 
in five metropolitan areas to examine staffing issues in child care centers. The centers served children of 
different ages and from different family income levels. Data were collected primarily dirough classroom 
observations and staff interviews between February and August 1988. The study used two of the 
instruments discussed earlier (die ECERS and die Arnett Scale). 

4. Cost, Quality, and ChUd Outcomes in Child Care Centers (CQCO) Study 

The recendy released CQCO study examined the relationship between child care costs, the quahty 
of care, and child development (Cost, Quality, and Child Outcomes Stutfy Team 1 995). The stutfy looked 
at a series of issues involving early care and education: (1) how market competition affects the cost and 
quality of care; (2) how regulations, standards, and program characterisdcs influence the cost and quality 
of care; (3) how the dimensions of die classroom and program environment eidier inqirove or diminish the 
quality of care; and (4) how different aspects of die quahty of care influence children’s cognitive and 
social-emotional development. Using a random sample, stratified by both auspice and state-hcensing 
standards. Cost, Quality, and Child Outcomes Stucfy Team 1995 selected a total of 50 norqirofit and 50 
for-profit centers per state in California, Colorado, Connecdcut, and Nordi Carolina for the study. From 
each center, two classrooms were randomly selected and a total of 826 children were observed in the 
classroom setting. Observations were conducted during spririg 1993 and diild assessments in summer 
1993. While die findings cannot be generalized to the entire population of providers in the United States, 
the centers seem to reflect the national population of licensed centers offering full-time care to infants, 
toddlers, ^d preschoolers. 



5. Head Start Family and Classroom Correlates Outcomes (HSFCC) Study 

The HSFCC study examined 145 Head Start children in 32 classrooms to investigate (1) how 
classroom quality affects child development outcomes, specifically controlling for the level of 
developmental stimulation that a child receives in the home environment; and (2) how teacher education, 
e:q)eriaice, and attitudes relate to classroom quality (Bryant, Burchinal, Lau, and Sparling 1994). More 
than 85 percent of Head Start classrooms in one southern metropolitan area agreed to participate in the 
study. The sampling frame included a relatively even distribution of urban, suburban, and rural 
classrooms. Four children from each classroom, two boys and two girls, were randomly chosen to 
participate in the study, and nearly 70 percent of those contacted agreed to participate. Classroom 
observations were conducted during the 1990-1991 and the 1991-1992 school years to collect information 
on classroom dynamics, among other variables. 

6. Profile of Child Care Settings (PCCS) Study 

The Department of Education commissioned die PCCS study to collect descriptive information on the 
population and characteristics of formal early care and education programs (Kisker et al. 1991). 
Information was obtained through conqiuter-assisted telephone interviews with a nationally representative 
sample of child care center directors and regulated home-based providers of early care and education 
programs. The PCCS was designed to (1) collect national data on the availability and characteristics of 
early care and education options available to parents, and (2) examine the characteristics of early care and 
education settings that have been associated with child care quality. The sample of 2,672 programs 
included Head Start, regulated home-based, public-school-based, and other center-based programs. The 
interviews were conducted during late 1989 and early 1990. 
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7. National Transition Study (NTS) 



Through a combination of surveys and site visits, die NTS investigated how pubhc schools help 
children make die transition to kindergarten and how diey can help to develop preschool-kindergarten 
continuity (Love, Logue et al. 1992). A stratified random san^le of 1,003 pubhc school districts 
containing kinuergartens was selected. High-poverty-level districts and districts widi large enrollments 
were oversan^led. Up to two schools widi kindergarten classes were dien randomly sanqiled from each 
district, resulting in a total san^ile of 1,662 schools. Self-report mail surveys were conducted widi both 
die districts and die sdiools between November 1 989 and March 1 990; site visits were conducted during 
spring 1990 to eight schools serving primarily disadvantaged students. 

8. Comprehensive Child Development Program (CCDP) Evaluation 

The Ad mini stration on Children, Youth and Families (ACYF) commissioned a national five-year 
mqiact evaluation of die CCDP. More dian 30 CCDP projects, located across die country, provide a wide 
set of con^irehensive services (including early child care and developmental services) for low-income 
famihes. Case managers help to coordinate the provision of services (including comprehensive social 
services for infants and young children to meet developmental needs, as well as services to help parents 
develop effective parenting skills and achieve economic and social self-sufficiency) from different 
providers within a community. Continuous assistance and services are provided until die children reach 
elementary school. The evaluation, which includes 21 of the original 24 CCDP projects, randomly 
assigned a total of 4,400 project families to either the CCDP treatment groiq> or a control groiqi. Data for 
die inqiact evaluation were collected from fall 1991 through fall 1994. The two-year interim report focused 
on how die CCDP affects child development and maternal outcomes, such as economic self-sufficiency, 
life management skills, and psychological and physical status (St Pierre et al. 1994). 
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9. Head Start Family Service Center (FSC) Demonstration 

Hie FSC demonstratiQn projects serve primarily low-income children and their famihes and provide 
a set of comprehensive services in' education, health, parent involvement, and social services (Abt 
Associates 1992). The Administration on Children, Youth, and Families (ACYF) sponsored the 
demonstration to learn about ways in which Head Start programs address the interrelated problems of 
illiteracy, substance abuse, and unen^loyment. Head Start families in 13 FSCs (which represented more 
than 30 percent of die total number of FSCs) were assigned to either a treatment group or a control group. 
Random assignment and interviewing were implemented between spring 1992 and spring 1994. 

The demonstration will ultimately be evaluated in terms of a variety of outcomes that describe the 
program’s impact on children and famihes, including their economic and social behaviors and progress, 
service utilization, and relationship to the community. 

10. Even Start Family Literacy Program Evaluation 

The Even Start family hteracy programs serve children and families by providing a set of services that 
help parents to support die educational development of their children. Even Start projects currendy serve 
more than 1 0,000 famihes across die country and are designed to provide a comprehensive and integrated 
set of services relating to three areas; (1) early childhood education, (2) adult basic skills and hteracy, and 
(3) parenting education. The Department of Education is sponsoring the national evaluation of the Even 
Start family hteracy programs to determine the impact of Even Start on outcomes relating to early 
childhood, adult, and parenting education (St. Pierre, Swartz, Murray, Deck, and Nickel 1993). For the 
in-depth study, five Even Start projects all implemented a random assignment process by assigning 
potential participants to either the Evrai Start treatment group or a control groiqi. The study covered parts 
of four school years from 1990 to 1993. 
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11. Job Opportunities and Basic Skills (JOBS) Training Program Evaluation 

The JOBS training program created under Ae Family Siqjport Act of 1988 intends to help AFDC 
recipients increase Aeir educational attainment and job training and, in so doing, increase Aeir 
employment, earnings, and economic self-sufficiency. JOBS requires nearly all AFDC adults to participate 
and finances enqjloyment and training services, as well as child care assistance. The longitudinal JOBS 
evaluanon follows q>proximately 55,000 AFDC recipients and ^hcants from seven sites who have been 
randomly assigned to one of three groups: (1) Ae human coital development treatment group, (2) Ae 
labor force attachmoit treatment group, or (3) Ae control group. The evaluation is examining how JOBS 
services and child care assistance affect parents and Aeir chilAen (Manpower Demonstration Research 
Corporation and Child Trends, Inc. 1992; and 1993). Data collection began m spring 1992 and wiU 
continue, to some degree, Arough 1996. Two smaller stuAes are embedded within Ae larger JOBS 
evaluation: (1 ) Ae child outcomes subsAdy, and (2) Ae JOBS observational substudy. The child outcomes 
subsAdy is followmg ^rproximately 3,000 families m three of Ae seven sites and examining Ae effects 
of Ae JOBS intervention on chil Aen’s cogrative development, social competence, adjustment, and healA 
and safety. TTie observational subsAdy mvolves videotapmg moAer-child mteractions m ^proximately 
370 families. 

Information on moAers’ child care arrangements is bemg gaAered through parent mterviews m Ae 
child outcomes subsAdy. Parents are bemg asked to assess several aspects of Aeir child’s care 
arrangement, mcluding Ae type of arrangement, changes m Ae arrangement, cost of Ae care, level of 
subsidizanon, group size, and staff characteristics. Parents are also assessmg Ae educational attainment 
and child-related training of Aeir diild’s caregiver. These variables are being used m Ae JOBS evaluation 
and Ae child outcomes subsAdy A determine, among oAer tilings, how child outcomes differ for chilAen 
wiA Affering child care arrangements. 
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EARLY CHILDHOOD ENVIRONMENT RATING SCALE (ECERS) 



Developer/Date: 


T. Harms and R.M. Clifford (1980) 


Description: 


37-item, seven-point rating scale on the quality of the classroom, organized in 
teims of personal-care routines of children; furnishings and display for children; 
language and reasoning experiences; fine and gross motor activities; creative 
activities; social development; and adult needs. 

Each item is scored 1 to 7, “Inadequate” to “Excellent,” with descriptions 
provided for ranks 1, 3, 5, 7. 


Purpose: 


To provide extensive descriptive information on the classroom and to make 
complex judgments on the quahty of the environment. Highest scores are 
awarded on the basis of multiple components; caregiver behavior, use of 
materials, types of materials, and arrangement of activities and materials. 

Items and definitions of ranks are generated fix>m research, performance indicators 
of quahty dt^ care and early childhood programs, and input from practitioners. 


Administration 
and Training: 


Ratings are based on two to three hours of observation of a classroom. Observers 
also need to obtain information from schedules and teachers to complete the 
scale. 

Developers state that the scale can be used by persons with a “practical 
acquaintance with early childhood settings and materials.” Training materials 
available include Audio-Visual Kit, Viewer’s Guide, Training Workbook. 
Training recommendaticHis include two practice observations of at least two hours 
each in a classroom. 


Scoring: 


Scores are computed by adding ranks (1 to 7) for items in each subscale. A total 
score is obtained by adding scores for all 37 items. Total score ranges from 37 to 
259. 


Relevant 

Environments: 


Preschool classrooms for children ages 3 to 6. 



Psychometric 

Information: 



ReUabUity; 

1 . hiter-rater reliability by class; in three tests, correlations were .90, .79, and .88 
(^proximately 20 classrooms were examined). 

2. Inter-rater reliability by hran: on 2S classrooms, rank order correlation on item 
was .93. 

3 . Internal consisten(ty (Cronbadi alphas) from the Observational Stucty of Early 
Childhood Programs (Ltyzer et al. 1993) 

Total score (37 items) = .92 

Subscores: 

Personal care (5) = .64 
Furnishings (5) = .72 
Language (4) = .87 
Motor activities (6) = .78 
Creative activities (7) = .73 
Social development (6) = .74 
Adult needs (4) = .70 

4. Factor analysis from the National Child Care Stafiing stucty (Whitebook et al. 
1989) examined two components, one relating to tqrpropriate caregiving, die 
odier to developmentally c^ipropriate activity. 

Appropriate caregiving (S2 percent of die variance) 

Factor loadings; 

Greetings/departure = .63 

Meals/snacks = .67 

Ni^i/rest = .63 

Ditqiering/toileting = .57 

Understanding language = .79 

Using language = .83 

Reasoning = .77 

Informal language = .78 

Supervision-fine motor activities = .80 

Supervision— gross motor activities = .68 

Music/movement activities = .60 

Schedule of creative activities = .71 

Supervision of creative activities = .70 

Free play = .78 

Group time = .72 

Tone of interactions = .79 
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Examples of 
Previous Use: 



Developmentally J^propriate activities (48 percent of the variance) 

Factor loadings; 

Furnishings for learning = .71 
Fu rnishings for relaxation = .70 
Room arrangement = .85 
Fine motor activities = .73 
Art activities = .74 
Block activities = .78 
Sand and water activities = .68 
Dramatic play = .66 
Space to be alone = .63 
Cultural awareness activities = .51 



1 . Face validity: Items were reviewed and rated by day care e:q)erts; 78 percent 
of ratings indicated items were highly important. 

2. Concurrent validity: ECERS rating of 18 classrooms correlated .74 with 
independent ratings by experts. 

Observational Study of Early Childhood Programs (Layzer et al. 1993) 

National Child Care Staffing study (Whitebook et al. 1989) 

Head Start Family and Classroom Correlates study (Bryant et al. 1994) 

Cost, Quality, and Child Outcomes in Child Care Centers 
(Cost, Quality, and Child Outcomes Study Team 1995) 



Validity; 
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Developer/Date: 



Description: 



Purpose: 



Administration 
and Training: 



Scoring: 



Relevant 

Environments: 



ASSESSMENT PROFILE FOR EARLY CHILDHOOD 
PROGRAMS: RESEARCH MANUAL 
(ASSESSMENT PROFILE) 



M. Abbott-Shim, A Sibley, and J. Neel (1992) 

The Assessment Profile is a structured observation guide designed to assist in 
self-assessment to inprove die quality of early childhood programs. The research 
version includes 87 criteria organized into five scales; 

• Learning environment (17 criteria) 

• Scheduling (IS criteria) 

• Curriculum (22 criteria) 

• Interacting (IS criteria) 

• Individualizing (18 criteria) 

The criteria, or items, represent observable procedures, behaviors, and records 
that exemplify a set of standards for classroom practices. Criteria are scored 
dichotomously as either “yes” or “no.” 

To determine whether program characteristics indicative of quality are present 



Information to clarify observations, documentation, and procedures is obtained 
from three sources; (1) observation, (2) review of documentation, and (3) staff 
rqxiits or teacher interviews. Training time is estimated to be approximately 10 
hours. One observer can coQect data for three classrooms in one day. The manual 
is available with instructions for administering die Assessment Profile. 

In coding, each of die 87 criteria on die checklist is coded as Yes/No. In scoring, 
die number of criteria scored as “Yes” are totaled for each scale. 



The Assessment Profile is intended for assessment of early childhood programs. 
Versions are available for use widi infant classrooms (for children from birth to 
age 2) and school-age classrooms (for children ages S to 10 i^o attend anodier 
school and participate in before- and afier-school care). 
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Psychometric 

Information: 



ReUabUity: 

1 . Intemal consistency (Cronbach alphas) are reported in the Research Manual; 



Subscores; 

Learning environment = .87 
Scheduling = .79 
Curriculum = .87 
Interacting = .98 
Individualizing = .97 



Validity: 

Authors present criterion related validity with die Early Childhood Environment 
Rating Scale total scores of .64 to .74 in recent studies. 



Examples of 

Previous Use: Observational Study of Early Childhood Programs (Layzer et al. 1993)' 

California Staff/Child Ratio study (Love, Ryer, and Faddis 1992)' 



'Note; Used an earlier version; Abbott-Shim and Sibley (1987). 
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ARNETT SCALE OF CAREGIVER BEHAVIOR (ARNETT SCALE) 



Developer/Date: 


J. Amett(1989) 


Description: 


Rating scale of caregiver behavior consisting of 26 items organized vmder five 
areas: 

1. Positive relationships 

2. Punitiveness 

3. Detachment 

4. Permissiveness 

5. Prosocial interaction 


Purpose: 


To rate the emotional tone, discipline style, and responsiveness of teachers and 
caregivers in a classroom. The items focus on the emotional tone and 
responsiveness of the caregiver’s interactions with children. The scale does not 
address issues of curriculum or other classroom management issues (such as 
grotq)ing or flow of activities). 


Administration 
and Training: 


Coding was based on a day of observation of a classroom in die National Child 
Care Staffing study (Whitebook et al. 1 989). The scale was coded several times 
during the day (morning, late morning, aflemoon) after a specified period of 
observation. 


Scoring: 


Total score conqiuted by summing ranks (1 to 4) across 26 items. Ratings on 
each hern range fiiom 1 = “Not at all characteristic of the caregiver” to 4 = “Very 
characteristic of die caregiver.” 


Relevant 

Environments: 


Early childhood classrooms. 


Psychometric 

Information: 


ReliabiUty: 

1 . Internal consistency (Cronbach alphas) from the Observational Study of Early 
Childhood Programs (Layzer et al. 1993) 



Examples of 
Previous Use: 



Wannth/responsiveness rating (10) = .91 
Harshness rating (7) = .90. 

2. Factor analysis from the Observational Study of Early Childhood Programs 
identified four factors that, combined, accounted for 60 percent of the 
variance; 

Positive, warm/responsive behavior (38 percent) 

Harsh, punitive b^avior ( 1 2 percent) 

Detachment (6 percrait) 

Firm, controlling bdiavior (5 percent) 

3. In the National Child Care Staffing study (Whitebook et al. 1989), factor 
analysis showed diree frctors diat accounted fbr 60 percent of die variance; (1 ) 
sensitivity, (2) detachment, and (3) harshness. In die California StaifiChild 
Ratio study (Love, Ryer, and Faddis 1992), frtctor analysis showed four factors 
that accounted for 60 percent of the variance; (1) attentive and aicouraging, 
(2) harsh and critical, (3) detached, and (4) controlling. 



Observational Study of Early Childhood Programs (Layzer et al. 1993) 
California StaffrChild Ratio Study (Love, Ryer and Faddis 1992) 

National Child Care Staffing Study (Whitebook et al. 1 989) 

Cost, Quality, and Child Outcomes in Child Care Centers (Cost, Quality, and 
Child Outcomes Study Team 1 995) 
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CLASSROOM PRACTICES INVENTORY (CPI) 



Developer/Date : 



Description: 



Purpose: 



Administration 
and Training: 







LayzeT et al. (1993) adq>tation of die Classroom Practices Inventory (Hyson, 
Hirsh-Pasdc, and Rescoila 1990), also referred to as the Developmental Practices 
Inventory. 



30-item rating scale assessing die curricular enqihasis of early childhood 
programs; 

* IS items describe “developmentally appropriate” practices 

• 15 items describe “developmentally inappropriate” practices 

The first 20 items are die 10 appropriate and 10 in^propriate items irom die 
original CPL Tai new items, also takai fiom the NAEYC guidelines, were added 
by Goodson (1990). Six emotional-climate items from the original CPI are not 
included in die Goodson adaptation. 

The rating scale is based on NAEYC’s guidelines for Developmentally 
Appropriate Practices (1987) for 4- and 5-year-olds. The guidelines su gg est 
clearly contrasting classroom practices, whidi were the basis for CPI items. 



To classify classroom and curriculum practices, teacher behaviors, children’s 
activities, and teacher-child interactions are rated as developmentally ^ipropriate 
or in^propriate. Developmentally ^propriate practices emphasize direct 
experiences, concrete materials, child-initiated activity, social interaction, and 
adult warmdi. 



Ratings based on several hours of direct observation. 

Indie Academic Environments study (Hyson, Hirsh-Pasek, and Rescorla 1989), 
10 programs were visited twice widiin two weeks by observers with tr aining and 
experience in early childhood. In addition, 48 d^ care settings were visited by 
students in eariy childhood courses; each program was observed for two and a half 
hours. 

Training of student observers consisted of reviewing con^lete NAEYC 
guidelines, reviewing the items, and doing practice classrcxim observations. 
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Scoring: 



Relevant 

Environments: 



Psychometric 

Information: 



The score is based on a five-point scale for 30 items. Ratings on each item range 
from 1 = “Not at all like this” to 5 = “Very much like fiiis.” The total score is 
produced by summing item ratings (wifii negative items reversed). The possible 
range of scores is 30 to 1 SO, wifii higher scores indicating more developmentally 
^ropriate practice. 



Early childhood programs for 4- and S-year-olds. 



26-item CPI used in 207 observations of 58 programs, including a range of 
settings (Hyson, Hirsh-Pasek, and Rescorla 1990). 

ReUabUity: 

1 . Internal consistency (Cronbach alphas) 

Appropriate program items (10) = .92 
In^propriate program items (10) = .93 
Total program items (20) = .96 
Emotional climate (6) = .88 
Total ^propriateness (26) = .96 

2. Intercorrelations among items; all intercorrelations were highly significant, 
i^jpropriate and in^propriate program items correlated r = -.82. Emotional 
climate correlated wifii program focus, r = .81. 

3 . Factor analysis; four-factor solution, with first factor accounting for S3 percent 
of the variance. Results suggest fiiat “developmental q^propriateness” as 
conceptualized by die CPI may be viewed as a single factor. 

4. Interobserver reliability; based on observations of 10 programs, exact 
interobserver agreement (to die same scale point) averaged 64 percent. 
Agreement within 1 scale point was 98 percent. Total CPI scores correlated 
.86 across pairs of raters. 

Validity: 

Concurrent validity; CPI scores were related to programs’ community reputations 
as academic or play-oriented and unstructured and to die self-reported educational 
attitudes of die program teachers. 



Examples of 
Previous Use: 



Observational Study of Early Childhood Programs (Layzer et al. 1993) 
California StafG'Chdd Ratio study (Love, Ryer, and Faddis 1992) 
Study of Academic Environments in Early Childhood 
(Hyson, Hirsh-Pasek, and Rescorla 1989 and 1990) 





PRESCHOOL CLASSROOM SNAPSHOT (PCS) 


Developer/Date: 


Ruopp et al. 1979; adapted by Layzer et al. (1993) and Love, Ryer, and Faddis 
(1992). 


Description: 


Records a relative^ static picture of die distribution of adults and children widiin 
activities at a particular point in time. The sn^shot records (1) activities 
occurring (27 categories, including admini.strative, concrete/manipulative, 
symbohc, and active pl^), (2) child grouping patterns (small, medium, large 
groiqis), (3) frequency of activities, (4) adult interaction with groups, (S) teacher 
and aide responsibihties, and (6) child independence. 


Purpose: 


To obtain detailed information on how children are grouped in a classroom, how 
the adults are distributed widi respect to groupings of children, and die activities 
children are engaged in. 

The activity categories include activities in which a preschool class might be 
routinely engaged during an ordinary day. 


Administration 
and Training: 


Snapshot is con^leted at the beginning of each five minutes of observation of the 
caregiver. A snapshot is coded four times an hour, just before die caregiver-child 
interaction. 


Scoring: 


Snapshots of a classroom can provide multiple scores; 

• Overall frequency of particular activities 

• Distribution of children in small, medium, or large groups 

• Distribution of adults 


Relevant 

Environments: 


Preschool classrooms. 


Psychometric 

Information: 


None available; however, in die Observational Study of Early Childhood 
Programs, Layzer et al. found diat die mean frequencies of individual activities 
and groupings calculated for die first frill d^ of snapshot observation were not 
significantly different from the mean frequencies calculated for a full five days of 
snapshot observations. 
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Examples of 
Previous Use: 



Observational Study of Early Childhood Programs (Layzer et al. 1993) 
California Staffi^Child Ratio study (Love, Ryer, and Faddis 1992) 
Project Giant Step Evaluation (Jarvis 1989) 
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